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Building  Inspection  Commission 
1 660  Mission  Street,  Sixth  Floor 
San  Francisco,  CA  94103 

President  and  Members: 

The  Controller’s  Audits  Division  presents  its  report  concerning  the  performance  audit  of  the 
Department  of  Building  Inspection  (department)  of  the  City  and  County  of  San  Francisco 


This  report  concludes  that  for  the  department  to  assess  whether  it  is  effectively  and  fairly 
enforcing  building  codes  that  protect  public  safety,  it  should  improve  its  performance 
measures.  In  addition,  the  report  shows  that  the  department  has  not  consistently  referred 
certain  building  projects  for  collection  of  development  impact  fees  resulting  in  millions  of 
dollars  of  lost  revenue  to  the  City.  The  report  also  concludes  that  the  department  has  not 
ensured  that  its  employees  are  professionally  certified  and  that  they  obtain  continuing 
professional  education  credits  as  required  by  state  law.  The  report  further  concludes  that  the 
department’s  methods  for  recording  and  reporting  on  its  activities  need  improvement.  Finally, 
surveys  indicate  that  employees  and  customers  are  generally  satisfied  with  the  department,  but 
some  areas  need  improvement. 

The  report  includes  several  appendices,  including  the  results  of  a related  audit  conducted  by 
management  consultant  KPMG.  Copies  of  that  report  are  available  from  this  office. 

The  department’s  response  is  attached  to  this  report.  The  Controller’s  Audits  Division  will 
work  with  the  department  to  follow  up  on  the  status  of  the  recommendations  made  in  this 
report. 
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EXECUTIVE  SUMMAR  Y 


Results  in  Brief 


Although  the  Department  of  Building  Inspection 
(department)  of  the  City  and  County  of  San  Francisco 
(City)  has  many  ways  to  measure  its  efficiency,  the 
department  does  not  adequately  measure  and  report  on  the 
effectiveness  of  its  work  so  that  it  can  determine  if  it  is 
fully  accomplishing  its  mission.  The  department  cannot 
assess  whether  it  is  meeting  its  mission  because  it  lacks 
performance  measures  that  could  indicate  whether  it 
effectively  and  fairly  enforces  codes  to  protect  public 
safety.  In  addition,  the  department  has  caused  the  City’s 
Municipal  Railway  and  the  San  Francisco  Unified  School 
District  (school  district)  to  fail  to  collect  millions  of  dollars 
in  fees  because  the  department  does  not  consistently  refer 
projects  subject  to  two  project  impact  fees  that  developers 
owe.  Our  audit  also  showed  that  the  department  does  not 
ensure  that  its  staff  receives  the  training  and  certification 
required  by  state  law.  Further,  although  the  department 
generally  meets  its  goals  of  providing  prompt,  efficient 
service,  the  department  uses  inefficient,  unreliable 
processes  for  recording  and  reporting  information  on  its 
response  time  and  productivity.  Finally,  most  of  the 
department’s  customers  and  employees  express  satisfaction 
with  the  department,  but  some  customers  and  employees 
believe  that  some  areas  of  the  department’s  operations  need 
improvement. 

A separate  but  related  audit  of  the  department  performed  by 
KPMG  under  contract  to  the  Controller’s  Office  found  that 
the  department’s  permit  issuance  process  has  minor 
quality-control  gaps  that  raise  the  risk  of  substandard 
construction,  process  and  technology  issues  that  delay 
permit  issuance,  insufficient  use  of  quality  controls  and 
technology  that  hampers  the  productivity  and 
responsiveness  of  inspectors,  and  frontline  contact  with 
customers  that  is  inefficient  and  inconvenient.  The  results 
of  the  KPMG  audit  appear  in  more  detail  in  Appendix  E. 
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Background 


Although  the  Department 
Gauges  the  Efficiency  of 
Its  Efforts , It  Should  Also 
Measure  the  Effectiveness 
of  Its  Work 


The  purpose  of  the  department  is  to  serve  the  City  and  the 
general  public  by  ensuring  that  life  and  property  are 
safeguarded  and  to  provide  a public  forum  for  community 
involvement  in  that  process. 

To  fulfill  its  purpose,  the  department  does  the  following: 

• Reviews  residential  and  commercial  building  plans. 

• Issues  building,  electrical,  plumbing,  and  street  space 
permits  for  proposed  and  in-progress  projects. 

• Inspects  buildings  and  sites  for  conformity  with 
approved  permits  and  federal,  state,  and  local  building 
codes. 

• Conducts  community  outreach  activities. 

• Investigates  complaints  of  violations  of  the  building, 
plumbing,  electrical,  housing,  and  disability  access 
codes,  and  lead  hazard  reduction  and  environmental 
health  and  safety  requirements. 

The  department’s  two  primary  functions,  issuing  permits 
and  inspecting  buildings,  are  the  basis  for  its  organizational 
structure.  As  of  October  2000,  the  department  had  284 
employees.  Its  fiscal  year  2000-2001  budget  is  $34  million. 
The  department  operates  as  an  enterprise  fund;  therefore, 
any  surplus  revenue  is  carried  forward  and  accumulated  as 
a reserve.  The  department’s  operations  are  funded  primarily 
from  charges  for  its  services. 

The  department  has  not  developed  performance  measures 
or  reports  that  gauge  the  effectiveness  of  its  inspection  and 
permit  processes.  Consequently,  the  department  cannot  be 
certain  that  it  adequately  fulfills  its  mission  to  safeguard  the 
life  and  property  of  San  Franciscans.  However,  the 
department  has  many  standards  for  evaluating  its 
employees'  promptness  and  productivity  in  issuing  permits 
and  in  conducting  inspections,  probably  more  than  it  needs. 
The  department  could  better  assess  its  effectiveness  and 
report  more  meaningful  results  if  it  had  measures  that 
gauge  the  quality  as  well  as  the  quantity  and  timeliness  of 
its  work. 

The  department's  current  performance  measures  also  lack 
direct  ties  to  a strategic  plan  that  outlines  the  department's 
vision  and  guides  its  programs.  The  department's  plan 
meets  the  City's  requirements  but  has  shortcomings  that 
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The  Department  Does  Not 
Consistently  Refer  Projects 
Subject  to  Fees  That 
Developers  Owe  the  City 
and  the  School  District 


The  Department  Does  Not 
Adequately  Monitor 
Employee  Certification, 
Training,  or  Evaluation 
and  Could  Improve  Its 
Fleet  Management 
Practices 


impede  the  department's  ability  to  fulfill  its  mission  by  not 
linking  mission  to  goals,  goals  to  objectives,  and  objectives 
to  performance  measures.  Although  the  department  has 
many  written  objectives  for  staff  productivity,  the  strategic 
plan  does  not  clearly  link  these  objectives  to  the 
department's  broader  goals.  In  addition,  the  department 
should  strengthen  its  policies  to  help  ensure  that  its 
employees  do  not  provide  improper  preferential  treatment 
to  customers,  including  outside  expediters. 

The  department  does  not  properly  identify  and  refer  all 
construction  projects  subject  to  fees  owed  the  City  by 
building  developers  or  owners.  We  estimate  that  the 
Municipal  Railway  has  not  billed  or  collected  $3.5  million 
in  Transit  Impact  Development  Fees  since  July  1985  and 
that  the  school  district  may  have  failed  to  collect  hundreds 
of  thousands  of  dollars  in  school  fee  revenue.  No 
management  review  is  built  into  the  department’s  process 
for  identifying  and  referring  projects  subject  to  the  two 
fees,  the  process  has  few  automated  checks,  and  policies 
and  procedures  for  this  process  are  inadequate.  The 
department  does  not  compile  permit  data  to  tabulate  the 
creation  of  new  residential  or  nonresidential  space,  so  there 
is  no  way  for  the  Municipal  Railway,  the  school  district,  or 
department  management  to  know  whether  the  department 
refers  all  projects  that  may  be  subject  to  the  two  fees. 

Because  the  department  has  not  adequately  recorded  or 
monitored  employee  certification,  training,  or  evaluation,  it 
cannot  be  certain  that  it  is  complying  with  state  law  or  that 
its  employees  receive  appropriate  feedback  on  their 
performance  from  their  managers.  In  fact,  25  percent  of 
department  employees  required  by  state  law  to  earn 
certification  may  not  have  done  so.  Consequently,  the 
department  is  exposing  the  City  to  legal  liability  from 
dissatisfied  customers  or  others  for  not  being  able  to  show 
that  its  staff  are  properly  certified  and  trained  as  required 
by  state  law.  Furthermore,  the  department  does  not  have 
policies  and  procedures  in  place  for  it  to  record  and  monitor 
employee  certification  and  training.  Without  such  policies 
and  procedures,  the  department  does  not  have  consistent, 
reliable  information  on  the  status  of  employees  who  require 
certification  and  training. 

Most  of  the  department’s  129  employees  who  responded  to 
our  employee  survey  question  about  performance 
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The  Department  Uses 
Inefficient , Unreliable 
Processes  for  Recording 
and  Reporting 
Information  on  Its 
Productivity  and 
Timeliness 

evaluations  report  they  have  not  received  evaluations  in 
more  than  a year,  and  19  percent  of  those  responding  say 
they  have  never  been  evaluated.  According  to  the  City’s 
Department  of  Human  Resources,  departments  should 
evaluate  their  employees  at  least  annually.  Without 
documentation  about  their  job  performance,  employees  do 
not  know  whether  they  are  performing  their  responsibilities 
adequately. 

We  also  found  that  the  department  does  not  keep  adequate 
records  to  ensure  that  it  reports  the  unpaid  car  benefit  that 
federal  law  requires  be  applied  to  all  employees  who  drive 
city  cars  home  at  night.  We  found  that  the  department  did 
not  report  this  benefit  for  more  than  half  the  employees 
who  receive  it.  Further,  the  department  does  not  have 
adequate  procedures  to  manage  its  city  vehicle  fleet. 

The  department,  and  especially  its  Plan  Check  Services 
unit,  relies  too  heavily  on  manual  processes  to  calculate  its 
performance  statistics.  These  processes  are  unnecessarily 
time-consuming  and  subject  to  error.  Because  the  resulting 
statistics  are  the  department's  primary  means  for 
determining  whether  its  employees  are  productive, 
inaccurate  figures  could  present  a misleading  picture  of  the 
department’s  performance.  Without  accurate  performance 
statistics,  department  management  and  city  decision  makers 
cannot  be  sure  that  the  department  is  as  efficient  as  it 
reports.  Moreover,  staff  members  are  spending  unnecessary 
amounts  of  time  tabulating  statistics  that  computerized 
systems  could  calculate  more  quickly  and  accurately. 

Further,  the  productivity  results  that  the  department  reports 
for  its  building  inspectors  appear  to  be  overstated. 

Although  the  reported  promptness  of  building  inspections 
is  accurate,  the  recorded  number  of  building  inspections 
and  the  resulting  reported  level  of  inspector  productivity 
are  inflated.  This  situation  has  occurred  because  the 
Building  Inspection  Division  counts  as  inspections  some  of 
the  building  inspectors’  other  activities  and  some  tasks  that 
are  not  inspection  activities  at  all.  Finally,  the  Housing 
Inspection  Services  Division  should  improve  its  reporting 
of  performance  results  and  its  record  keeping,  particularly 
of  how  housing  inspectors  spend  their  time  on  code 
enforcement  cases,  and  establish  performance  goals  that 
better  reflect  its  objective  to  see  that  code  violations  are 
corrected. 
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The  Department's 
Customers  and  Employees 
Generally  Express 
Satisfaction  With  the 
Department 


Key  Recommendations 


We  surveyed  the  department's  customers  and  employees  to 
learn  their  perceptions  about  the  department's  performance. 
Our  surveys  revealed  that  customers  and  employees  are 
generally  satisfied  with  the  department  but  identified  certain 
areas  of  concern.  Customers  raised  some  concerns  about  the 
level  or  quality  of  certain  services  provided  by  the 
department,  while  employees’  concerns  were  mostly  related 
to  outside  influences  on  the  department  and  to  workplace  and 
employment  issues.  Department  management  should  be  able 
to  address  many  of  these  concerns  easily  and  may  correct  or 
enhance  its  delivery  of  services  to  the  public  based  on  the 
results  of  these  surveys. 

To  improve  its  operations,  the  Department  of  Building 
Inspection  should  act  on  all  the  recommendations  presented 
in  this  report,  including  those  key  recommendations  outlined 
below: 

To  gauge  how  well  it  is  accomplishing  its  mission  of 
effective,  fair,  and  safe  code  enforcement,  the  department 
should  take  these  steps: 

• Develop  a strategic  plan  that  will  result  in  a 
comprehensive  set  of  goals  and  objectives  linked  to  the 
department’s  mission.  The  department  should  create  a 
plan  that  brings  together  the  department’s  vision, 
mission,  goals,  objectives,  and  performance  measures 
and  review  it  annually. 

• Formulate  a limited  set  of  performance  measures  that  not 
only  address  the  department’s  promptness  and 
productivity  but  also  its  effectiveness. 

• Establish  an  explicit  policy  prohibiting  its  employees 
from  giving  any  customer  improper  preferential 
treatment.  This  policy  should  be  part  of  a code  of  ethics 
developed  by  the  department,  with  assistance  from  the 
City’s  Ethics  Commission,  and  adopted  by  the  Building 
Inspection  Commission  for  the  department's  use. 

To  identify  and  refer  more  effectively  the  construction 
projects  subject  to  impact  fees  owed  to  the  City  and  the 
school  district,  the  department  should  enhance  its 
procedures  and  systems  in  the  following  ways: 

• Establish  in  the  permit  tracking  system  an  automated 
reminder  for  staff  to  verify  that,  when  required,  the 
Transit  Impact  Development  Fee  and  School  Facility 
Impact  Fee  have  been  paid. 
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• Ensure  that  Permit  Services  Program  supervisors  spot- 
check  permit  applications  regularly  to  see  that  clerks  are 
referring  applications  appropriately  to  the  San  Francisco 
Municipal  Railway  and  the  San  Francisco  Unified  School 
District. 

To  ensure  that  its  employees  are  professionally  certified 
and  trained  in  accordance  with  state  law  and  to  more 
consistently  evaluate  the  performance  of  its  employees , the 
department  should  take  these  actions: 

• Develop  a policy  on  professional  certification  and 
training  of  employees  that  states  the  legal  requirements, 
affected  employees,  acceptable  types  of  training,  and 
consequences  for  those  who  do  not  comply. 

• Establish  a procedure  for  how  the  department  will  collect 
and  maintain  employee  certification  and  training 
information  and  how  the  department  will  enforce  training 
and  certification  requirements. 

• Ensure  that  all  employees  receive  performance 
evaluations  at  least  annually. 

To  use  more  efficient , reliable  processes  for  recording  and 
reporting  performance  statistics,  the  department  should  do 
the  following: 

• To  save  staff  time  and  provide  more  accurate  reports, 
ensure  that  the  Plan  Check  Services  unit  works  with  the 
Management  Information  Services  Division  to  automate, 
as  much  as  possible,  the  calculation  of  performance 
statistics. 

• Make  certain  that  the  Building  Inspection  Division 
includes  only  actual  inspections  in  the  counts  it  uses  to 
calculate  inspector  productivity. 

• Have  the  Housing  Inspection  Services  unit  consider 
using  as  a performance  measure  the  number  of,  or  the 
rate  at  which,  violations  are  corrected  rather  than 
counting  as  resolved  (abated)  only  those  cases  that  have 
paid  their  final  bills. 

To  obtain  and  use  valuable  comments  on  its  operations,  the 
department  should  conduct  its  own  customer  and  employee 
surveys  in  the  future  and  use  the  results  as  a guide  to 
improve  business  processes,  management  and  staff 
relations,  and  customer  services. 

In  addition,  the  department  should  act  on  all  the 
recommendations  presented  in  KPMG’s  audit  report. 
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including  the  selected  recommendations  below: 


Department  Response 


• To  demonstrate  that  the  department  is  thoroughly 
enforcing  the  codes,  add  controls  to  ensure  that  staff 
thoroughly  and  accurately  reviews  permit  applications 
and  plans.  The  department  should  then  report  the  results. 

• To  issue  permits  more  efficiently,  research  the  most 
common  complaints  about  the  One-Stop  process  and 
train  staff  of  the  One-Stop  Permit  division  to  remedy 
these  types  of  complaints. 

• To  approve  more  plans  while  customers  wait,  assess  the 
potential  for  giving  engineering  staff  a greater  role  in  the 
initial  counter  screening  during  the  plan-check  process. 

• To  realize  greater  inspector  productivity  through  less 
manual  paperwork,  acquire  existing  paperless  technology 
that  will  streamline  the  inspection  records  process. 

• To  improve  customer  service,  make  uniform  the  hours 
during  which  customers  can  schedule  building, 
plumbing,  and  electrical  inspections. 

• To  reduce  the  time  customers  wait  on  the  telephone, 
install  an  automated  voice-response  system  to  handle  and 
track  data  on  incoming  calls. 

• To  increase  the  productivity  of  plan  checkers,  refer  code- 
related  questions  to  the  Technical  Services  Division. 


The  Department  of  Building  Inspection  believes  the  audit 
report  is  insightful  and  will  be  useful  in  its  ongoing  efforts  to 
improve  its  service  delivery.  The  department's  full  response 
it  attached  to  the  report. 
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INTRODUCTION 


Created  in  1 994  by  voter  referendum,  the  Department  of  Building  Inspection 

(department)  and  the  Building  Inspection  Commission  (commission)  regulate 
building  projects  in  the  City  and  County  of  San  Francisco  (City).  The  department 
serves  the  City  and  the  general  public  by  safeguarding  life  and  property  in  San  Francisco, 
and  providing  a forum  that  involves  the  community  in  that  process.  The  mission  of  the 
department  is  to  oversee  the  effective,  efficient,  fair,  and  safe  enforcement  of  the  City’s 
building,  housing,  plumbing,  electrical,  and  mechanical  codes  and  of  disability  access 
regulations.  The  commission’s  role  is  to  direct  and  manage  the  department,  and  the 
commission  holds  public  hearings  on  appeals  and  other  issues  related  to  the  department’s 
decisions  and  practices. 

Under  the  commission’s  supervision,  the  department  does  the  following: 

• Reviews  residential  and  commercial  building  plans. 

• Issues  building,  electrical,  plumbing,  and  street  space  permits  for  proposed  and  in- 
progress projects. 

• Inspects  buildings  and  sites — including  new  construction,  additions,  alterations  and 
repairs — for  conformity  with  approved  permits  and  federal,  state,  and  local 
construction  laws. 

• Conducts  community  outreach  activities. 

• Investigates  complaints  of  violations  of  the  building,  plumbing,  electrical,  housing, 
and  disability  access  codes,  and  lead  hazard  reduction  and  environmental  health  and 
safety  requirements. 

As  an  extension  of  the  commission,  the  department  has  the  authority  to  approve  or  deny 
new  construction  projects  through  the  plan  review  and  permitting  process.  In  addition, 
through  the  building  inspection  process,  the  department  can  issue  notices  of  code 
violations. 

The  commission  consists  of  seven  members.  Three  members  are  appointed  by  the  Board 
of  Supervisors,  and  four  are  appointed  by  the  mayor.  According  to  Section  D3. 750-4  of 
the  city  charter,  the  commission  has  the  authority  to  organize,  reorganize,  and  manage  the 
department.  The  commission  appoints  the  director  of  building  inspection  (director),  who 
is  responsible  for  appointing  the  department’s  other  leadership  positions,  including  one 
assistant  director  and  two  deputy  directors.  The  assistant  director  oversees  all 
administrative  functions  of  the  department,  one  deputy  director  is  responsible  for  the 
Permit  Services  Program,  and  one  deputy  director  manages  the  Inspection  Services 
Program. 
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PRIMARY  FUNCTIONS  OF  THE  DEPARTMENT 


The  department  has  two  primary  functions:  It  reviews  plans  and  issues  permits  for 
proposed  and  in-progress  construction  projects,  and  it  inspects  buildings,  structures,  and 
sites  for  their  compliance  with  local,  state,  and  federal  laws  regulating  construction  and 
site  improvements  in  the  City.  The  department’s  two  main  service  programs.  Permit 
Services  and  Inspection  Services,  have  divisions  to  perform  specific  functions.  The 
Permit  Services  Program  encompasses  two  units:  Permit  Processing  Services  and  Plan 
Check  Services.  The  Inspection  Services  Program  includes  building,  electrical  and 
plumbing  inspection;  housing  inspection;  and  enforcement  of  codes  and  regulations.  In 
addition  to  these  two  programs,  the  department’s  Administration  Program  manages  the 
administrative  responsibilities  of  the  department.  Exhibit  1 illustrates  the  department’s 
organizational  structure. 

Exhibit  1 

Department  of  Building  Inspection 
Organizational  Chart 
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The  department  had  284  employees  allocated  to  its  various  divisions  as  of  October  2000, 
and  most  worked  in  the  Permit  Services  and  Inspection  Services  Programs.  The 
department  receives  no  funds  from  the  City’s  general  fund  but  operates  as  an  enterprise 
fund;  it  derives  its  revenue  from  fees  charged  for  plan  checking,  permitting,  and 
licensing.  Any  surplus  revenue  that  remains  at  the  end  of  the  fiscal  year  is  carried  forward 
to  the  next  year’s  budget  and  accumulated  as  a reserve  for  future  expenditures. 


THE  PERMIT  PROCESS 

Most  permit  applicants  submit  their  applications  to  the  department’s  Central  Permit 
Bureau  counter.  If  counter  staff  accept  the  application,  plan  checkers  review  the  plans  for 
compliance  with  building  codes.  Once  plan  checkers  have  approved  the  plans  and  the 
department  has  prepared  the  permits,  the  Central  Permit  Bureau  issues  the  permits. 
Applicants  may  submit  to  an  express  window  for  expedited  review  any  projects  that  do 
not  require  review  by  other  city  departments.  On  the  other  hand,  permit  applicants  who 
have  projects  requiring  review  and  approval  by  several  city  departments — such  as  the 
Department  of  Public  Health,  Department  of  Public  Works,  Fire  Department,  and 
Planning  Department — can  choose  to  submit  their  applications  and  plans  to  the 
department’s  One-Stop  Permit  Coordination  (One-Stop)  counter.  The  One-Stop  permit 
process  helps  expedite  permit  issuance  by  having  the  plans  reviewed  simultaneously  by 
the  appropriate  departments.  Exhibit  2 briefly  describes  the  permit  application  process. 

Exhibit  2 


The  Permit  Application  Process  at  the 
Department  of  Building  Inspection 
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THE  INSPECTION  PROCESS 


The  inspection  function  includes  both  construction  inspection — building,  plumbing,  and 
electrical — and  housing  inspection.  Inspectors  for  both  types  of  reviews  perform  code 
enforcement  inspections  and  respond  to  citizen  complaints.  Housing  inspectors  also 
regularly  inspect  apartments  and  hotels.  Exhibit  3 shows  the  basic  elements  of  the 
inspection  process. 


Exhibit  3 

The  Inspection  Services  Process  at  the 
Department  of  Building  Inspection 


Customer  obtains 
permit  and  starts  work. 


Department  generates  job  card 
for  inspector  to  use  when 
inspecting  the  work. 


f \ 

(Customer  contacts 
Department  to 
schedule  required 
inspection(s). 

^ r —J 


REFERRALS  TO  OTHER  CITY  AGENCIES 

Developers  of  certain  residential  or  nonresidential  space  are  subject  to  two  fees — the 
Transit  Impact  Development  Fee  and  the  School  Facility  Impact  Fee — that  are  collected 
with  the  assistance  of  the  department  and  are  based  on  the  square  footage  of  the  project. 
Authorized  by  the  City’s  administrative  code,  the  Transit  Impact  Development  Fee  is 
intended  to  help  alleviate  the  financial  burden  of  increased  use  of  the  City’s  public 
transportation  system  that  office  development  causes  in  the  downtown  area.  Established 
by  state  law,  the  School  Facility  Impact  Fee  grants  school  districts  the  ability  to  levy  a fee 
on  certain  construction  projects.  This  fee  helps  fund  the  construction  or  reconstruction  of 
school  facilities. 
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BUDGET  FOR  FISCAL  YEAR  2000-2001 


The  department’s  commitment  to  improvements 
in  customer  service  is  evident  throughout  its 
fiscal  year  2000-2001  budget.  At  $34.2  million, 
the  department’s  total  budget  emphasizes 
customer  service  through  additional  allocations 
for  more  frontline  inspection  staff,  additional 
community  outreach  programs,  Web  site 
enhancements,  improvements  to  permit  and 
complaint  tracking  systems,  and  an  expansion  of 
the  department’s  offices  at  1660  Mission  Street. 
This  budget  shows  an  increase  from  actual 
expenditures  of  $28.6  million  in  fiscal  year 
1999-2000  and  $28.0  million  in  fiscal  year 
1998-99.  As  Exhibit  4 indicates,  the  department 
spends  79  percent  of  the  current  budget  on 
customer-oriented  services  related  to  permits 
and  inspections. 


The  purpose  of  this  audit  was  to  assess  the  performance  of  the  main  services  and 
management  controls  of  the  department  and  to  identify  areas  for  improvement.  The 
secondary  purpose  of  this  audit  was  to  complement  an  audit  performed  by  KPMG  LLP 
(KPMG)  by  assessing  areas  of  the  department  that  KPMG  did  not  evaluate  and 
conducting  a more  thorough  review  of  some  functions  that  it  did  review  (see  KPMG’s 
work  at  Appendix  E).  We  evaluated  the  department’s  management  controls — that  is,  the 
tools  it  uses  to  operate,  including  those  related  to  strategic  planning,  policies  and 
procedures,  and  performance  measurements — to  ensure  it  is  achieving  its  objectives.  We 
reviewed  recent  budgets,  the  most  recent  annual  report,  and  other  documents  to  assess  the 
adequacy  of  the  department’s  performance  measures,  management  reports,  and  vehicle 
fleet  management. 

We  also  analyzed  the  reported  performance  of  the  department’s  principal  functions: 
permit  issuing  and  building  and  housing  inspection.  To  accomplish  this  review,  we 
conducted  interviews  of  staff  and  management;  examined  reported  performance  results, 
complaint  handling,  employee  training  and  certification  data  in  light  of  state 
requirements;  and  conducted  surveys  of  staff  and  customers. 

To  gauge  the  effectiveness  of  the  department  in  collecting  fees  for  the  Municipal  Railway 
and  San  Francisco  Unified  School  District,  we  assessed  the  processes  by  which  the 
department  identifies  and  refers  projects  subject  to  the  fees  and  tested  judgmental  samples 


Exhibit  4 

Expenditures  by  Program 
Fiscal  Year  2000-2001 


SCOPE  AND  METHODOLOGY 
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of  projects  to  determine  the  reliability  of  the  department’s  processes.  We  also  used 
Planning  Department  data  to  estimate  the  amount  of  square  footage  subject  to  the  Transit 
Impact  Development  Fee  and  compared  that  figure  to  the  amount  of  square  footage  the 
department  actually  referred  to  the  Municipal  Railway. 

To  obtain  comments  from  department  staff  on  various  issues,  such  as  departmental 
management,  employees’  job  satisfaction,  workload,  and  training,  we  conducted  a 
confidential  survey  of  all  staff,  including  senior  management.  The  survey  asked  both 
closed-  and  open-ended  questions  to  elicit  employee  attitudes  and  opinions  about  working 
for  the  department  and  about  working  with  customers.  The  survey  also  solicited  ideas  and 
suggestions  for  improving  the  department.  We  distributed  the  results  of  the  survey  to  all 
department  staff. 

In  addition,  at  our  request,  the  Public  Research  Institute  of  San  Francisco  State  University 
conducted  a survey  to  gauge  the  satisfaction  and  experiences  of  the  department’s 
customers.  This  survey  was  mailed  to  approximately  2,500  department  customers,  and  it 
asked  closed-  and  open-ended  questions  about  customers’  experiences  with  the 
department  and  their  perceptions  of  the  service  they  received.  We  presented  the  results  of 
this  survey  to  the  department’s  senior  management. 
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CHAPTER  1 


ALTHOUGH  THE  DEPARTMENT  GAUGES  THE  EFFICIENCY  OF 
ITS  EFFORTS,  IT  SHOULD  ALSO  MEASURE  THE 
EFFECTIVENESS  OF  ITS  WORK 


CHAPTER  SUMMARY 

The  Department  of  Building  Inspection  (department)  for  the  City  and  County  of  San 
Francisco  (City)  has  not  developed  performance  measures  or  reports  that  gauge  the 
effectiveness  of  its  inspection  and  permit  processes.  Consequently,  we  were 
unable  to  gather  data  that  would  allow  us  to  determine  fully — and  the  department  cannot 
determine  fully — whether  the  department  is  fulfilling  its  mission  to  safeguard  the  life  and 
property  of  San  Francisco  residents.  On  the  other  hand,  the  department  has  many 
standards — probably  more  than  it  needs — for  evaluating  its  employees'  timeliness  and 
productivity  in  conducting  inspections  and  issuing  permits.  More  specific  performance 
measures  that  gauge  effectiveness  as  well  as  quantity  and  timeliness  of  work  would  help 
the  department  better  assess  its  effectiveness  and  report  meaningful  results.  In  addition, 
the  department  and  the  public  would  benefit  from  a fully  realized  quality-control  check 
for  the  department's  plan-check  function,  including  a performance  measure  that  would 
allow  the  department  to  demonstrate  that  the  plan-check  function  is  conducted  thoroughly 
and  properly. 

The  department's  current  performance  measures  also  lack  direct  ties  to  a strategic  plan 
that  outlines  the  department's  vision  and  guides  its  programs.  The  department's  three-year 
strategic  plan  fulfills  the  City's  charter  and  administrative  code  requirements  but  has 
shortcomings  that  impede  the  department's  ability  to  fulfill  its  mission  and  that  prevented 
us  from  analyzing  thoroughly  the  department's  overall  performance.  Although  the 
department  has  many  written  objectives  for  staff  productivity,  the  strategic  plan  does  not 
clearly  link  the  objectives  either  to  the  department's  broader  goals  or  to  its  specific 
performance  measures. 

In  addition,  the  department  needs  to  begin  measuring  the  promptness  and  efficiency  of 
the  service  provided  by  the  One-Stop  Permit  Coordination  unit.  Such  a measurement 
would  allow  the  department  to  compare  these  service  qualities  with  those  of  the 
department’s  conventional  permit  approval  process. 

Finally,  the  department  lacks  policies  for  ensuring  that  employees  avoid  giving  improper 
preferential  treatment  to  customers  or  their  agents.  According  to  a survey  we  conducted, 
some  of  the  department's  plan  checkers  and  inspectors  believe  that  some  customers 
receive  improper  preferential  treatment. 
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BACKGROUND 


To  enable  its  organization  to  succeed,  management  must  develop  detailed  processes  to 
guide  staff.  For  example,  planning,  organizing,  and  controlling  are  key  responsibilities  of 
management.  Tools  managers  use  to  control  the  functions  of  their  organizations  include 
policies  and  procedures,  forms,  records,  performance  standards  for  employees  and  the 
organization  as  a whole,  budgets,  and  management  information  reporting.  Such 
management  controls  support  the  elements  of  a strategic  plan,  enabling  a department  to 
achieve  its  goals  and  minimize  risks. 

The  City  passed  an  ordinance  in  2000  mandating  that  each  city  department  develop  goals 
and  performance  measures  to  better  address  public  needs.  The  ordinance  states  that  the 
departments’  articulation  of  vision,  mission,  and  goals  will  improve  program  efficiency 
and  effectiveness  and  help  the  Board  of  Supervisors  make  policy  and  spending  decisions. 
To  this  end,  the  San  Francisco  Charter,  Section  9.1 14,  requires  that  each  department 
develop  a budget  that  contains,  among  other  things: 

• The  overall  mission  and  goals  of  the  department. 

• Strategic  plans  that  guide  each  program  or  activity. 

• Productivity  goals  that  measure  progress  toward  achieving  strategic  plans. 

The  San  Francisco  Administrative  Code,  Section  3.5,  further  requires  that  each 
department  do  the  following: 

• Identify  pol  icy  outcome  measures  that  reflect  the  mission  and  goals  of  the  department 
and  that  can  be  used  to  gauge  progress  toward  attaining  these  goals. 

• Develop  and  review  annually  a three-year  strategic  plan  to  reflect  policy  outcomes 
from  the  operations  of  the  department  consistent  with  the  then-approved  budget. 

THE  DEPARTMENT’S  LACK  OF  AN  ADEQUATE  STRATEGIC  PLAN 
IMPEDES  ITS  ABILITY  TO  FULFILL  ITS  MISSION 

The  department  has  complied  with  the  San  Francisco  Administrative  Code 
(administrative  code)  requirement  to  develop  a strategic  plan,  but  this  plan  is  not 
comprehensive,  and  its  deficiencies  hinder  the  department’s  ability  to  achieve  its  mission. 
Although  the  department  has  prepared  a three-year  plan,  it  does  not  contain  all  the 
elements  found  in  a model  strategic  plan,  which  clearly  states  an  organization’s  vision  for 
the  future,  its  mission,  its  goals,  objectives  that  flow  from  those  goals,  and  performance 
measures  that  will  indicate  progress  toward  accomplishing  the  objectives.  The  plan 
should  directly  connect  the  goals  and  objectives  to  the  department’s  mandated  duties,  as 
expressed  in  the  mission  statement.  The  department  has  developed  some  of  the  elements 
of  a model  plan,  such  as  a mission  statement  and  performance  measures,  but  it  needs  to 
integrate  them  in  a cohesive  plan  that  can  guide  its  programs. 
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A Model  Strategic  Plan  Links  an 
Organization  *s  Vision,  Mission, 

Goals,  and  Objectives 

Using  authoritative  literature  and  the  Controller’s  Performance  Measurement 
Instructions,  we  developed  a model  of  the  strategic  planning  process,  which  Exhibit  5 on 
the  following  page  describes.  Each  step  in  strategic  planning  is  essential  to  the  step  that 
follows,  beginning  with  the  vision  statement.  A vision  statement  consists  of  principles, 
standards,  or  qualities  an  organization  considers  worthwhile  and  the  fundamental  beliefs 
on  which  the  organization  bases  its  practices.  For  example,  a building  inspection 
department’s  vision  of  its  regulatory  role  should  be  oriented  toward  ensuring  that  life  and 
property  are  safeguarded.  Reflecting  the  vision  and  intent  of  the  organization,  the  mission 
statement  clarifies  the  organizational  purpose  without  providing  details  of  the  method  for 
achieving  it. 

The  strategic  plan’s  goals  and  objectives  specify  how  an  organization  will  accomplish  its 
mission.  Goals  identify  the  general  changes  or  results  that  must  be  achieved  to  fulfill  the 
vision  and  carry  out  the  mission.  Goals  can  be  internal  or  external  to  the  organization, 
depending  on  the  result  desired.  For  example,  in  building  inspections,  an  internal  goal 
may  be  to  respond  to  all  housing  complaints  within  a specific  time,  while  an  external  goal 
may  be  to  improve  the  condition  of  the  City’s  housing.  After  an  organization  determines 
its  goals,  it  needs  to  develop  specific  activities — or  objectives — to  achieve  the  goals. 
Finally,  the  organization  must  establish  specific  ways  to  measure  its  performance. 
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Exhibit  5 

A Standard  Strategic  Planning  Process  for  Organizations 


A future-oriented  process  of  diagnosis  of  problem  areas,  objective  setting,  and  strategy  building  that  is 
an  essential  part  of  quality  management.  This  process  relies  on  careful  consideration  of  an 
organization’s  capacities  and  environment  and  leads  to  significant  decisions  about  allocation  of 
resources.  Strategic  planning  emphasizes  effective  uses  of  resources  to  achieve  meaningful  results. 


A compelling  image  of  the  desired  future.  Vision  is  the  inspiration  for  all 
other  components  of  the  strategic  planning  process. 


A broad,  comprehensive  statement  of  purpose  that  identifies  what  the 
department  does  and  who  the  department  serves.  The  Department  of 
Building  Inspection’s  mission  is  the  following: 

Under  the  direction  and  management  of  the  seven-member  citizen 
Building  Inspection  Commission,  to  oversee  the  effective,  efficient,  fair 
and  safe  enforcement  of  the  City  and  County  of  San  Francisco’s 
Building,  Housing,  Plumbing,  Electrical  and  Mechanical  Codes,  along 
with  the  Disability  Access  Regulations. 


Broad  statements  that  describe  desired  outcomes,  such  as  training  all 
plumbing  inspectors  on  the  new  California  Plumbing  and  Mechanical 
Codes. 


Milestones  or  intermediate  achievements  that  are  necessary  to  realize 
goals.  Specific  and  measurable,  objectives  describe  the  exact  results 
sought,  include  timetables  for  accomplishment,  and  set  standards  for 
performance. 


PERFORMANCE 

MEASURES 


INPUT:  Measures  that  address  the  quantity  of  resources  the 
organization  will  use,  such  as  budgeted  funds  and  number  of  staff. 


OUTPUT:  Measures  that  address  the  quantity  of  work  performed  or 
sen/ices  delivered,  such  as  the  number  of  permits  issued. 


EFFICIENCY:  Measures  that  indicate  the  cost  or  productivity 
associated  with  a given  output  or  outcome,  such  as  cost  per 
inspection. 


OUTCOME:  Measures  that  assess  a program's  effect,  such  as 
percentage  of  building  inspections  conducted  correctly,  thereby 
contributing  to  the  occupants’  safety.  Outcome  measures  evaluate  the 
impact  of  actions  and  compare  the  actual  result  with  the  intended 
result.  The  San  Francisco  Administrative  Code  specifically  mandates 
that  departments  use  policy  outcome  measures. 
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The  Department's  Strategic  Plan  Fails  to 
Link  Objectives  and  Performance  Measures 
to  the  Broader  Goals  of  the  Department 

When  the  department  prepared  its  three-year  plan  for  1998-99  through  2000-01,  it  did  not 
include  in  the  plan  the  department’s  vision  and  mission  statements  or  its  broad  program 
goals.  It  also  did  not  identity  which  of  the  items  listed  are  objectives  and  which  are 
performance  measures.  For  example,  it  lists  as  equivalent  items  for  fiscal  year  2000-2001 
a qualitative  objective  such  as  “implement  San  Francisco  2000  Building  Code”  and  a 
specific,  quantitative  performance  measure  such  as  “approve  95  percent  of  all  residential 
alteration  permits  within  24  hours  or  less,  and  98  percent  within  seven  days.”  The  plan 
also  mixes  goals  and  objectives.  For  example,  for  fiscal  year  1998-1999,  the  plan  says 
that  the  Permit  Services  Program  will  create  a specialized  plan-check  section  for  projects 
requiring  disabled  access  (an  objective)  to  improve  permit  screening  at  the  counter  (a 
goal).  Further,  the  plan  neither  links  the  objectives  and  measures  to  the  broader  goals  of 
the  department  nor  shows  how  the  specific  performance  measures  flow  from  the 
department’s  objectives.  Instead,  this  two-page  document  consists  of  a three-year,  line- 
item  budget  for  the  department  and  a list  of  statements  for  each  of  these  years  for  the 
three  major  areas  within  the  department:  the  Permit  Services  Program,  Inspection 
Services  Program,  and  Administration  Program.  Some  of  the  statements  are  quantitative 
performance  measures — for  example,  increasing  community  outreach  efforts  by  25 
percent — and  others  appear  to  be  objectives  to  meet  unstated  goals — for  example,  issuing 
routine  permits  over  the  Internet. 

The  department  has  some  of  the  building  blocks  of  a high-quality  strategic  plan  because  it 
publishes  other  documents,  such  as  its  annual  report,  that  include  its  mission  statement 
and  selected  goals  of  the  department’s  many  divisions.  In  addition,  the  documents  we 
reviewed  as  part  of  this  audit  indicate  that  the  department  understands  the  value  of 
preparing  plans  that  include  specific  objectives,  and  the  documents  show  that  the 
department  is  committed  to  performance  measurement.  The  next  steps  toward  a more 
integrated  planning  process  for  the  department  include  combining  all  the  elements  of  a 
comprehensive  strategic  plan  into  one  document. 


THE  DEPARTMENT  SHOULD  USE  FEWER  PERFORMANCE 
MEASURES  BUT  INCLUDE  MEASURES  THAT  REFLECT  THE 
EFFECTIVENESS  OF  ITS  SERVICES 

Although  the  department’s  performance  measures  are  generally  adequate  for  assessing 
the  department’s  productivity  and  timeliness,  their  number  is  unreasonably  large,  and 
none  focuses  on  the  outcomes  or  effectiveness  of  the  department’s  efforts.  Performance 
measures  allow  the  City  to  evaluate  whether  its  resources  are  used  for  maximum  benefit 
and  to  provide  accountability.  By  focusing  on  a few  key  measures  of  timeliness  and 
productivity  and  including  a few  effectiveness  measures,  the  department  could 
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demonstrate  to  policymakers  and  the  public  that  the  quality  of  its  services  is  of  the 
highest  caliber. 

The  Department  Has  Too  Many 
Performance  Measures 

The  department  has  established  a large  number  of  performance  measures  and  may  find  it 
difficult  to  collect  and  report  data  on  all  of  them.  As  of  August  2000,  the  Permit  Services 
Program  had  24  measures,  the  Inspection  Services  Program  had  14  measures,  and  the 
Administration  Program  had  14  measures.  Although  some  of  these  measures  are  the  same 
for  different  programs  and  divisions  of  the  organization,  the  existence  of  as  many  as  24 
performance  measures  for  a departmental  program  may  be  excessive.  It  must  be 
acknowledged  that  collecting,  analyzing,  and  reporting  data  on  just  one  measure  that 
involves  the  activities  of  dozens  of  staff  can  be  a labor-intensive,  demanding  exercise. 
Although  each  division  or  bureau  of  the  department  has  fewer  measures  than  exist  at  the 
program  level,  each  unit  of  each  program  must  typically  monitor  its  performance  on  5 to 
10  measures.  The  department  might  better  gauge  its  efficiency  by  having  each  program 
choose  a few  key  measures  of  timeliness  and  productivity  for  each  program  division. 

The  Department’s  Performance 
Measures  Reflect  Only  One 
Part  of  Its  Mission 

Almost  all  of  the  department’s  performance  measures  relate  to  efficiency.  However,  the 
department’s  mission  statement  says  that  the  department  is  to  oversee  effective,  efficient, 
fair,  and  safe  code  enforcement.  Although  indicators  of  the  department’s  promptness  and 
productivity  are  certainly  valuable,  the  department  reports  no  quantitative  results  of  how 
effectively,  fairly,  and  safely  it  enforces  the  codes.  The  department’s  many  performance 
measures  are  more  than  adequate  to  gauge  whether  the  department  is  delivering  services 
promptly  and  efficiently. 

The  Department  Deserves  Praise  for  Coordinating 
Program  Performance  Measures  With  Measures 
for  Each  Division  and  for  Using  Some  Measures 
Consistently  Across  Programs 

Although  the  department  has  too  many  performance  measures,  the  measures  for  the 
department’s  three  programs — the  Permit  Services  Program,  Inspection  Services 
Program,  and  Administration  Program — are  logical  in  that  they  correspond  to  the 
measures  for  the  programs’  divisions.  Making  these  connections  among  measures  helps 
the  department  ensure  that  it  will  meet  its  program  goals.  For  example,  the  Permit 
Services  Program  has  a measure  to  review  and  approve  95  percent  of  all  construction 
permits  within  seven  days.  To  help  the  program  achieve  this  level  of  performance,  the 
following  divisions  have  specific  goals: 
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• The  Residential  Plan  Check  Division  is  to  review  and  approve  90  percent  of  all 
permits  within  7 days. 

• The  Mechanical  Plan  Check  Division  is  to  review  and  approve  90  percent  of  all 
permits  within  1 5 days. 

• The  Major  Projects/Unreinforced  Masonry  Buildings  Plan  Check  Division  is  to 
review  and  approve  75  percent  of  all  permits  within  90  days. 

• The  Commercial  Plan  Check  Division  is  to  review  and  approve  90  percent  of  all 
permits  within  30  days. 

Thus,  each  division's  measures  correlate  to  its  parent  program’s  measures. 

The  department  also  has  done  an  admirable  job  of  using  some  of  the  same  performance 
measures  for  most  or  all  of  its  organizational  units.  This  consistency  demonstrates  that 
management  has  coordinated — although  not  explicitly — at  least  some  of  the  goals  of  the 
department  with  those  of  its  component  units,  and  it  allows  management  to  compare  the 
performance  of  divisions  on  these  measures.  Three  measures  are  common  to  every 
division  and  all  three  programs  in  the  department: 

• Replying  to  85  percent  of  the  director’s  (customer  complaint)  letters  within  the 
director’s  deadline. 

• Answering  100  percent  of  the  director’s  letters  five  days  after  the  director’s  deadline. 

• Responding  to  all  phone  calls  within  24  hours. 

The  Department  Should  Establish 
Effectiveness  Measures 

Although  building  inspection  agencies  in  other  jurisdictions  do  not  usually  measure  the 
outcomes  of  their  work,  the  department  could  devise  ways  to  measure  indirectly  how 
effectively  and  fairly  it  is  doing  its  job.  Indeed,  after  consulting  sources  such  as  the 
International  City/County  Management  Association  and  reviewing  model  performance 
measures  for  building,  plan  review,  and  code  enforcement  functions,  we  found  that  most 
measures  used  elsewhere  are  based  on  response  time,  cost  to  provide  service,  and 
productivity  of  staff.  The  response  time  and  productivity  measures  are  similar  to  those 
established  by  the  department.  Nevertheless,  the  department  would  benefit  by  measuring 
whether  plan-check,  inspection,  and  other  key  services  it  provides  are  performed 
accurately  and  thoroughly,  in  addition  to  knowing  that  its  services  are  timely  and 
delivered  efficiently.  It  is  such  measures  of  effectiveness,  indirect  as  they  may  be,  that 
will  show  that  the  department’s  code  enforcement  results  in  safe  structures  for  San 
Franciscans. 

The  department’s  current  measures  address  effectiveness  only  indirectly  and  only  for 
inspections,  with  division  goals  focusing  on  having  each  senior  inspector  or  senior 
housing  inspector  perform  five  spot-check  inspections  per  week.  However,  the 
department  has  no  measures  that  allow  for  consistent  reporting  on  the  results  of  those 
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spot  checks  and  that  have  as  the  ultimate  goal  the  ensuring  that  construction  will  result  in 
safe  conditions  for  the  building’s  occupants.  Such  measures  might  assess  the  following 
types  of  inspections: 

• Proper,  thorough  inspections — The  percentage  of  spot-check  inspections  verifying 
that  original  inspections  were  conducted  properly  to  ensure  that  all  work  complied 
with  applicable  codes. 

• Accurate  inspections — The  percentage  of  items  on  correction  notices  and  reports 
originally  noted  by  inspector  that  the  senior  inspector  deems  correct  or  necessary 
during  a spot-check  inspection. 

• Effective  follow-up  inspections — The  number  of  items  on  correction  notices  and 
reports  that  were  not  followed  up  on  in  subsequent  inspection(s). 

• Effective  inspections  of  housing — The  number  of  unsafe  housing  conditions 
identified  and  corrected  as  the  result  of  housing  inspections. 

Further,  the  department  could  evaluate  the  effectiveness  of  its  plan-check  function  to 
measure  the  department's  success  in  fulfilling  its  key  mission — that  is,  how  well  it 
ensures  that  the  department  approves  only  plans  for  safe  buildings  that  comply  with  all 
relevant  codes.  The  department  could  use  a quality-control  or  spot-check  process  to 
include  a review  that  would  provide  information  for  measures  such  as  the  following: 

• Accurate  plan  reviews — The  percentage  of  approved  plans  found  to  have  no 
substantive  errors  (for  example,  no  design  elements  contrary  to  code  and  no 
unnecessary  changes  noted  by  plan  checker). 

• Thorough  plan  reviews — The  percentage  of  approved  plans  found  to  have  no 
substantive  omissions  (all  necessary  changes  noted  by  plan  checker). 

• Plan  reviews  that  are  procedurally  thorough — The  percentage  of  approved  plans 
found  to  have  no  processing  errors  or  omissions  (such  as  initials  or  stamps  missing). 

The  City  of  Sunnyvale  includes  effectiveness  measures  for  both  its  inspection  and  its  plan 
review  functions.  Sunnyvale  assigns  staff  to  different  geographic  areas  of  the  city  and, 
during  one  year,  plan  review  and  inspection  staff  working  in  other  districts  audits 
approximately  10  percent  of  the  inspections  and  plan  reviews  performed  by  Sunnyvale. 
Sunnyvale  measures  the  quality  of  its  inspections  by  the  percentage  of  audited 
inspections  found  accurate.  The  percentage  of  audited  plan  reviews  found  to  be  accurate 
indicates  the  effectiveness  of  the  plan  review  function. 

The  Department  Should  Better 
Demonstrate  That  It  Assures  the 
Quality  of  Its  Plan-Check  Function 

The  department  does  not  systematically  measure  and  report  on  the  effectiveness  of  work 
perfoimed  by  the  Plan  Check  Services  group  to  demonstrate  that  the  department  approves 
only  plans  that  comply  with  codes.  Unlike  the  arrangement  at  the  Inspection  Services 
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Program,  Plan  Check  Services  has  no  written  procedure  and  does  not  document  the 
results  of  any  spot-checking  that  may  be  performed  by  supervisors  to  evaluate  work 
quality.  Before  Plan  Check  Services  approves  a permit  application,  the  application 
undergoes  the  department’s  quality-control  process.  This  is  a formal  process  in  which 
staff  uses  a checklist  to  review  each  set  of  plans  before  the  permit  is  approved.  Although 
the  department  contends  this  is  an  adequate  check  on  the  quality  of  the  plan  checkers’ 
work,  we  found  it  to  be  primarily  a check  of  plan  routing  and  completeness,  not  a re- 
check of  the  plans  to  ensure  the  quality  of  the  review  itself. 

We  found  that  at  least  one  division  of  Plan  Check  Services  had  taken  it  upon  itself  to 
conduct  its  own  quality  checks.  According  to  the  manager  of  the  Residential  Plan  Check 
Division,  because  so  many  of  its  plan  checkers  are  new,  his  division  has  instituted  an 
additional  check  before  applications  are  sent  on  to  the  next  station.  Department 
management  states  that  plan-check  supervisors  do  spot  check  their  subordinates’  work 
but  we  found  no  recording  or  reporting  of  such  checks  and  no  departmental  policy  or 
procedure  requiring  such  checks.  While  the  department’s  quality-control  process  is 
adequate  as  far  as  it  goes,  it  could  be  enhanced  with  documented  spot  checks  of  the 
quality  of  plan  checkers’  work. 

Moreover,  the  fire  safety  of  buildings  could  be  compromised  if  staff  of  the  San  Francisco 
Fire  Department  trained  for  this  function  do  not  evaluate  plans,  and  the  Department  of 
Building  Inspection  cannot  manage  this  risk  adequately  if  plan-check  supervisors  do  not 
consistently  review  and  document  the  quality  of  their  staffs  work.  As  noted  in  Chapter  2, 
we  found  a few  instances  of  the  department's  failing  to  refer  plans  to  the  Fire  Department 
although  the  Department  of  Building  Inspection’s  own  policy  requires  referral  of  the 
plans. 


THE  DEPARTMENT  SHOULD  MEASURE  THE  TIMELINESS 
OF  THE  SERVICE  OFFERED  BY  THE  ONE-STOP  PERMIT  UNIT 

The  department  contends  that  service  from  the  One-Stop  Permit  Coordination  unit  (One- 
Stop)  is  faster  and  easier  for  the  customer  than  the  normal  process  for  permit  application 
review,  but  the  department  cannot  conclusively  demonstrate  this  to  be  true.  One-Stop  is  a 
cooperative  effort  of  the  Department  of  Building  Inspection,  the  Planning  Department, 
the  Fire  Department,  the  Department  of  Public  Health,  and  the  Department  of  Public 
Works.  One-Stop  began  in  March  1 998  as  a way  to  expedite  permit  processing  for 
projects  requiring  at  least  three  review  stations.  It  has  been  one  of  the  department's  key 
efforts  in  improving  its  customer  service  in  the  permit  approval  process,  and  it  has 
received  significant  resources. 

As  discussed  in  Chapter  5,  almost  all  (98  percent)  of  the  customers  who  have  used  One- 
Stop  did  so  because  they  believed  it  is  faster  than  going  through  the  normal  process,  and 
nearly  half  (46  percent)  used  One-Stop  because  they  thought  it  would  be  easier  than  the 
normal  process. 
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The  department  itself  asserts  that  One-Stop  can  cut  permit  processing  time  approximately 
in  half.  Since  the  beginning  of  fiscal  year  2000-2001,  One-Stop  has  had  as  a goal  to 
report  turnaround  time  on  all  activities.  However,  One-Stop  has  reported  only  a few 
efficiency  results  and  has  not  done  so  in  the  same,  uniform  way  as  have  the  Commercial, 
Residential,  Mechanical,  and  Major/Unreinforced  Masonry  Building  Plan  Check 
Divisions.  As  a result,  we  could  not  determine  if  One-Stop  is  faster  than  the  normal 
process  or  by  how  much. 

The  department  measures  the  promptness  and  efficiency  of  permit  approval  for  the  four 
plan-check  divisions  in  terms  of  their  ability  to  review  and  approve  a certain  percentage 
of  permit  applications  within  a specified  number  of  days,  but  the  department  has  not  done 
so  for  One-Stop.  Nevertheless,  One-Stop  has  reported  some  figures  for  the  speed  with 
which  it  reviews  and  approves  applications.  In  the  department’s  most  recent  annual 
report,  for  fiscal  year  1998-99,  One-Stop  reported  how  quickly  it  processed  restaurant 
permits:  This  unit  took  an  average  of  three  weeks  if  fewer  than  two  plan  revisions  were 
submitted  or  an  average  of  57  days  if  two  or  more  revisions  were  submitted.  The  unit  also 
reported  on  the  speed  of  its  quality-control  review  (100  percent  within  24  hours)  and  its 
processing  time  for  application  intake  (average  reduced  from  90  minutes  to  30  minutes). 
However,  the  department  has  not  reported  efficiency  results  for  One-Stop  that  the 
department  can  compare  with  those  of  similar  projects  reviewed  through  the  normal, 
sequential  process  initiated  at  the  Central  Permit  Bureau.  If  the  department  knew  how 
much  faster  One-Stop's  process  is  than  alternative  processes,  it  could  make  more 
informed  decisions  about  the  level  of  resources  it  is  willing  to  commit  to  this  unit. 


THE  LACK  OF  CONTROLS  ON  OUTSIDE  EXPEDITERS 
PROMOTES  THE  PERCEPTION  OF  IMPROPER 
PREFERENTIAL  TREATMENT  BY  THE  DEPARTMENT 

Despite  the  availability  of  the  department's  One-Stop  process  and  the  general  promptness 
of  its  usual  processes  for  reviewing  and  approving  permit  applications,  certain  practices 
at  the  department  could  cause  some  customers  to  believe  that  they  need  to  hire  agents  to 
expedite  permit  or  project  approval  (expediters)  who  can  solicit  the  most  favorable 
treatment  by  the  department.  More  than  half  of  the  plan  checkers  responding  to  our 
survey  said  that  they  deal  every  day  with  agents  hired  by  customers  to  expedite  permit  or 
project  approval  (expediters).  More  than  a quarter  of  plan  checkers  (6  of  23)  reported  that 
an  expediter  had  asked  them  for  improper  preferential  treatment,  and  two-thirds  of 
responding  plan  checkers  said  that  they  have  seen  expediters  receive  such  treatment. 

Also,  almost  one-third  of  the  department’s  inspectors  (7  of  22)  responding  to  our  survey 
said  they  had  had  an  expediter  ask  them  for  and  had  seen  an  expediter  receive  improper 
preferential  treatment.  These  figures  reflect  a broader  trend  for  all  customers  of  the 
department.  Of  the  2 1 plan  checkers  responding  to  this  item,  6 (20  percent)  said  that  they 
had  witnessed  customers  receiving  preferential  treatment,  and  25  percent  said  that  a 
supervisor  had  asked  them  to  give  a customer  such  treatment.  These  responses  were  more 
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common  among  inspectors,  as  12  of  the  26  inspectors  (46  percent)  responding  said  that 
they  had  witnessed  customers'  receiving  improper  preferential  treatment,  and  37  percent 
said  that  a supervisor  had  asked  them  to  give  a customer  such  treatment. 

Although  we  cannot  say  what  forms  the  preferential  treatment  indicated  by  staff 
responding  to  the  survey  may  have  taken,  or  if  it  was  actually  improper,  it  might  have 
ranged  from  giving  one  project  priority  over  another  to  customers'  receiving  favorable 
plan  reviews  that  were  undeserved.  If  nothing  improper  is  occurring,  then  some 
employees  are  misinformed  as  to  what  constitutes  improper  preferential  treatment  or  are 
incorrectly  perceiving  what  appears  to  them  to  be  improper  preferential  treatment.  If, 
however,  customers  are  hiring  expediters  because  this  allows  them  to  receive  preferential 
treatment  from  the  department,  the  problem  is  one  of  actual  practice  and  not  just 
perception. 

The  department's  current  management  controls  cannot  adequately  ensure  that  it  treats  all 
customers  fairly  and  that  customers  cannot  expect  expediters  to  obtain  improper 
preferential  treatment  for  them.  Without  strong  management  controls  such  as  policies  and 
procedures,  the  department  risks  at  least  the  appearance  of  unfair  preference  for  some 
customers.  Beyond  establishing  policy,  the  department  should  inform  its  staff  of  what 
does  and  does  not  constitute  improper  preferential  treatment  and,  if  the  department  can 
define  the  practice,  proper  preferential  treatment.  Any  appearance  of  some  customers' 
receiving  unfair  preference  can  adversely  affect  the  department’s  reputation  and  morale. 
Moreover,  the  department  faces  not  just  the  risk  of  the  appearance  of  unfair  preference 
but  the  reality.  Stronger  management  controls  will  enable  the  department  to  mitigate  the 
risk  that  any  customer,  including  a permit  expediter,  receives  improper  preferential 
treatment. 

Although  some  controls  exist  that  promote  fairness  and  discourage  improper  preferential 
treatment  in  the  permit  and  inspection  processes,  they  are  not  adequate  to  assure  the 
department  that  such  treatment  does  not  occur.  According  to  the  deputy  director  for  the 
Inspection  Services  Program  (formerly  the  deputy  director  for  the  Permit  Services 
Program),  the  fact  that  no  one  has  sole  control  over  the  approval  of  a project  ensures  the 
accuracy  and  fairness  of  the  permit  process.  In  addition,  the  department  has  taken  a step 
to  control  expediters'  access  to  department  staff:  It  installed  gates  at  the  counter  of  the 
Permit  Center’s  first  floor  to  make  it  more  obvious  that  customers  may  not  enter 
employee-only  areas.  However,  the  department  lacks  other  management  controls  that 
would  minimize  the  risk  that  projects  handled  by  expediters  could  receive  preferential 
treatment  in  permits  or  inspections. 

As  we  discussed  earlier  in  this  chapter,  the  department  cannot  be  certain  of  the  quality  of 
the  plan-check  process,  including  its  accuracy  and  fairness.  Further,  the  department  has 
not  told  its  customers  that  they  are  not  to  expect  preferential  treatment  for  their  permit 
applications  or  projects  when  expediters  are  handling  the  customers’  applications.  The 
department  should  provide  the  same  level  of  service  to  all  customers  with  similar  projects 
regardless  of  whether  they  hire  expediters. 
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RECOMMENDATIONS 


To  ensure  that  the  Department  of  Building  Inspection  manages  and  measures  its 

performance  more  effectively,  the  department  should  do  the  following: 

• Develop  a strategic  plan  that  will  result  in  a comprehensive  set  of  goals  and 
objectives.  The  department  should  create  a plan  that  includes  the  department’s  vision, 
mission,  goals,  objectives,  and  performance  measures,  and  the  department  should 
review  this  plan  annually. 

• Establish  a limited  set  of  performance  measures  that  not  only  addresses  the 
department’s  efficiency  and  productivity  but  also  gauges  its  effectiveness. 

• Improve  or  add  to  the  existing  quality-control  procedure  to  ensure  that  the  plan-check 
and  permit  approval  processes  are  accurate  and  fair.  Thorough  and  documented  spot 
checks  by  supervisors  may  fulfill  this  recommendation.  The  department  could  report 
as  a performance  measure  the  results  of  these  spot  checks. 

• Measure  the  promptness  of  permit  application  review  and  approval  via  the  One-Stop 
process  versus  the  promptness  with  which  the  normal,  sequential  process  reviews 
equivalent  projects.  This  measure  would  help  the  department  assess  whether  the  One- 
Stop  unit  deserves  more  resources. 

To  avoid  even  the  appearance  of  inequitable  treatment  of  customers,  the  department  must 

state  clearly  that  fairness  is  a core  value  of  the  organization  and  ensure  that  its  employees 

and  customers  know  this  value.  To  do  so,  the  department  should  take  these  actions: 

• Implement  an  explicit  policy  prohibiting  its  employees  from  giving  any  customer 
improper  preferential  treatment.  This  policy  should  be  part  of  a code  of  ethics 
developed  by  the  department,  with  assistance  from  the  City’s  Ethics  Commission,  and 
adopted  by  the  Building  Inspection  Commission  for  the  department’s  use. 

• Establish  a process  that  allows  employees  who  may  be  whistleblowers  to  report  their 
concerns  to  department  management,  the  Building  Inspection  Commission,  or  the 
Ethics  Commission. 

• Amend  its  authorized  agent  form  to  inform  its  customers  in  writing  that  the 
department  does  not  regulate  expediters  or  afford  them  preferential  treatment. 
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CHAPTER  2 

THE  DEPARTMENT  DOES  NOT  CONSISTENTLY  REFER  TO 
THE  CITY  AND  THE  SCHOOL  DISTRICT  THE  PROJECTS 
SUBJECT  TO  IMPACT  FEES  FROM  DEVELOPERS 


CHAPTER  SUMMARY 

The  Department  of  Building  Inspection  (department)  does  not  properly  identify  and 
refer  to  the  appropriate  agencies  all  construction  projects  subject  to  fees  owed  to 
the  City  and  County  of  San  Francisco  (City)  by  building  developers  or  owners. 

We  were  able  to  collect  limited  data  from  the  department  on  properties  that  might  have 
been  subject  to  the  Transit  Impact  Development  Fee  (transit  fee).  In  doing  so,  we  found 
that  the  inconsistencies  in  the  department’s  processes  for  referring  projects  to  the  San 
Francisco  Municipal  Railway  (MUNI)  have  resulted  in  missed  fees  from  eight  buildings 
since  July  1985.  We  estimate  the  total  missed  revenue  to  be  $3.5  million.  Further, 
although  the  department  more  consistently  identifies  and  refers  to  the  San  Francisco 
Unified  School  District  (school  district)  the  building  projects  subject  to  the  School 
Facility  Impact  Fee  (school  fee),  the  school  district  can  miss  thousands  of  dollars  for  each 
case  in  which  a developer  does  not  pay  the  appropriate  school  fee.  However,  it  appears 
that  MUNI  and  the  school  district  can  collect  these  unpaid  fees  retroactively. 

The  department’s  process  for  collecting  these  two  fees  includes  no  management  review 
and  few  automated  checks.  The  department  does  not  compile  permit  data  about  the 
creation  of  new  residential  or  nonresidential  space,  so  MUNI,  the  school  district,  and 
department  management  have  no  method  for  ensuring  that  the  department  refers  to  MUNI 
and  the  school  district  all  projects  that  may  be  subject  to  the  two  fees.  The  department  has 
no  policies  explaining  its  role  in  collecting  these  fees,  and  its  procedures  are  out  of  date, 
particularly  regarding  the  transit  fee.  Because  other  agencies  collect  the  transit  fee  and 
school  fee  for  the  maintenance  and  improvement  of  their  facilities  and  services,  the 
referral  of  projects  subject  to  these  two  fees  appears  to  be  a lower  priority  for  the 
department  than  the  collection  of  the  permit  and  inspection  fees  that  fund  the 
department's  work.  However,  we  see  no  reason  that  the  department  could  not  more 
effectively  refer  projects  subject  to  these  two  fees. 

Finally,  the  department  appears  to  be  doing  an  adequate  job  of  assessing  permit-related 
fees.  Nevertheless,  it  could  improve  its  controls  to  prevent  the  possibility  of  abuse  when 
staff  enters  $1  in  the  permit  tracking  system  as  the  low  estimate  of  a construction 
project’s  value.  The  department  should  also  refer  all  projects  to  the  San  Francisco  Fire 
Department  (Fire  Department)  when  department  policy  requires  staff  to  do  so. 
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BACKGROUND 


Applicants  for  construction  permits  pay  fees  based  on  both  the  estimated  value  and  the 
square  footage  of  their  projects.  The  Department  of  Building  Inspection  and  other  city 
departments  that  must  approve  permit  applications  (such  as  the  Planning  Department  or 
Fire  Department)  charge  the  applicants  fees  for  reviewing  the  plans  or  inspecting  the 
work.  The  estimated  value  of  a project  determines  many  of  the  fees  charged,  but  some 
fees  are  fixed.  In  addition,  each  developer  of  residential  or  nonresidential  space  is  subject 
to  two  fees — the  Transit  Impact  Development  Fee  and  the  School  Facility  Impact  Fee— 
that  MUNI  and  the  school  district  collect  according  to  the  square  footage  of  the  project. 
Although  the  department  does  not  collect  these  two  fees,  it  is  responsible  for  identifying 
projects  subject  to  them  and  for  referring  those  projects  to  MUNI  or  the  school  district. 

The  San  Francisco  Administrative  Code  (administrative  code),  Chapter  38,  stipulates  that 
developers  of  new  office  space  in  the  downtown  area,  which  the  code  defines,  pay  the 
Transit  Impact  Development  Fee  to  alleviate  the  financial  burden  imposed  on  MUNI  by 
the  increased  transit  use  to  and  from  the  downtown  area. 

The  California  Education  Code  (education  code).  Section  17620,  authorizes  the 
governing  board  of  any  school  district,  including  the  San  Francisco  Unified  School 
District,  to  levy  a fee  on  any  construction  project  that  increases  floor  area  either  for 
residential  occupancies  of  more  than  500  square  feet  of  assessable  space  or  for  any 
commercial  or  industrial  occupancies.  These  fees  are  to  fund  construction  or 
reconstruction  of  school  facilities,  and  the  Education  Code  prohibits  any  city  or  county 
from  issuing  a building  permit  without  certification  that  the  developer  has  complied  with 
this  fee. 

The  department  identifies  building  projects  subject  to  the  transit  fee  and  the  school  fee 
when  developers  file  their  permit  applications,  and  the  department  is  responsible  for 
ensuring  that  buildings  subject  to  these  fees  are  not  occupied  until  the  fees  have  been 
paid.  The  department  refers  to  MUNI  those  developers  of  building  projects  that  may  be 
subject  to  the  transit  fee  so  that  MUNI  can  evaluate  whether  the  developers  owe  the  fee. 
The  department  also  determines  the  square  footage  of  projects  subject  to  the  school  fee 
and  provides  this  information  to  the  school  district. 

The  department  operates  as  an  enterprise  fund,  which  is  a type  of  fund  that  is  separate 
from  the  City’s  General  Fund.  The  department’s  services  are  funded  solely  by  fee 
revenues  generated  from  plan  checking,  permit  issuing,  and  licensing.  Any  surplus 
revenue  is  carried  forward  and  accumulated  as  a reserve. 
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THE  DEPARTMENT’S  INEFFECTIVE  PROCESS  FOR 
COLLECTING  THE  TRANSIT  IMPACT  DEVELOPMENT  FEE 
CAUSES  THE  CITY  TO  LOSE  SIGNIFICANT  REVENUE 


Because  the  department  has  not  properly  referred  some  construction  projects  to  MUNI, 
the  City  has  failed  to  assess,  bill,  and  collect  millions  of  dollars  in  transit  fee  revenue.  Our 
analysis  of  records  from  the  Department  of  Building  Inspection,  the  Planning 
Department,  and  MUNI  shows  that  the  City  could  have  collected  an  estimated  $3.5 
million  more  in  transit  fee  revenue  if  the  department  had  properly  referred  to  MUNI  all 
the  projects  we  reviewed  that  were  subject  to  the  fee.  We  identified  eight  office  space 
projects  created  in  the  downtown  area  of  San  Francisco  since  fiscal  year  1986-87  that 
were  subject  to  the  transit  fee  but  that  the  department  had  not  referred  to  MUNI. 

Since  1986,  the  City  Has  Not  Collected 

an  Estimated  $3.5  Million  in  Transit 

Impact  Development  Fees 

Because  the  department  did  not  refer  to  MUNI  the  eight  projects  subject  to  the  transit  fee, 
the  City  failed  to  assess  and  bill  building  developers  and  owners  approximately  $3.5 
million.  From  Planning  Department  records  covering  only  office  space  projects  of  more 
than  25,000  square  feet  approved  since  fiscal  year  1986-87,  we  found  three  projects 
subject  to  the  transit  fee  that  the  Department  of  Building  Inspection  should  have  known 
about  but  that  it  did  not  refer  to  MUNI.  These  three  buildings  created  234,845  square  feet 
of  new  office  space  and  owe  an  estimated  $1.17  million  in  transit  fees.  The  Planning 
Department  approved  two  of  these  buildings  since  July  1999,  while  the  third  was 
approved  in  1991.  In  addition,  the  Department  of  Building  Inspection’s  database  listed 
five  permits  issued  from  calendar  years  1997  through  1999;  however,  the  department 
failed  to  refer  the  projects  to  MUNI.  After  we  told  MUNI  about  the  projects,  MUNI 
determined  that  they  did  owe  the  transit  fee.  MUNI  estimates  that  developers  for  these 
five  projects  will  owe  about  $2.33  million. 

MUNI  is  taking  action  to  collect  the  transit  fees  from  the  developers  or  owners  of  all 
eight  buildings  we  identified.  These  estimates  are  based  on  the  transit  fee’s  full  rate  of  $5 
per  square  foot,  but  the  actual  fees  MUNI  may  charge  could  be  less  if  it  grants  any  of 
these  projects  discounts  because  of  the  administrative  code's  allowances  related  to 
previous  use  of  a property.  However,  even  the  high-end  estimate  is  a conservative 
calculation  of  the  transit  fee  revenue  that  the  City  has  lost  since  the  fee’s  inception  in 
1981  because  our  analyses  excluded  projects  of  less  than  25,000  square  feet  that  the 
department  approved  before  January  1 997  and  after  December  1 999,  and  our  estimates 
also  excluded  all  projects  approved  by  the  Planning  Department  before  July  1986. 

The  City  should  be  able  to  collect  all  of  the  transit  fee  revenue  it  has  not  assessed  in  past 
years.  According  to  a deputy  city  attorney,  if  the  City  has  not  billed  the  developer  or 
owner,  the  City  can  collect  an  unpaid  transit  fee  regardless  of  when  the  project  was  built. 
She  also  said  the  transit  fee  precedent  would  probably  enable  the  City  to  collect  other 
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unbilled  fees  as  well.  However,  the  City  has  only  three  years  to  collect  the  fee  once  it  has 
issued  the  bill. 

If  the  transit  fee  had  increased  over  the  years,  the  developers  that  have  not  yet  paid  their 
fees  would  owe  much  more  than  do  currently.  Surprisingly,  the  transit  fee  has  not  risen 
since  the  original  ordinance  was  enacted  in  1981,  setting  the  fee  at  $5  per  square  foot  of 
new  office  space.  The  San  Francisco  Administrative  Code,  Section  38.6,  states  that  the 
fee  schedule  shall  be  reviewed  annually  to  ensure  that  it  continues  to  reflect  the  projected 
cost  of  providing  the  additional  public  transit  service  required  by  new  developments.  Had 
the  transit  fee  increased  annually  since  1981  according  to  the  Consumer  Price  Index,  the 
fee  would  have  been  $9.49  per  square  foot  in  2000,  and  the  eight  projects  described  above 
would  owe  the  City  a total  of  $6.4  million  instead  of  $3.5  million. 

The  Department  Failed  to  Refer  to 

MUNI  7 of  13  Projects  in  Our  Sample 

During  our  audit,  we  reviewed  a sample  of  13  construction  projects  that  received  permits 
in  1997  through  1999  and  that  appeared  subject  to  the  transit  fee.  Our  analysis  showed 
that  the  department  failed  to  refer  7 (54  percent)  to  MUNI  so  that  MUNI  could  determine 
whether  the  projects'  developers  actually  owed  the  transit  fee.  The  developers  for  5 of  the 
other  6 building  projects  in  our  sample  had  paid  the  transit  fee,  and  MUNI  had 
determined  that  the  remaining  project  was  not  subject  to  the  fee. 

Of  the  seven  buildings  that  the  department  did  not  refer  to  MUNI,  two  were  assembly,  or 
meeting  spaces  renovated  for  business  uses.  One  permit  indicated  a building's  change  in 
use  from  storage  to  business,  another  from  factory  to  business,  and  another  from  a repair 
garage  to  business.  Yet  another  project  added  an  additional  story  to  a building  used  for 
business  purposes.  Because  these  projects  changed  the  buildings’  original  uses  to 
business  uses  or  added  square  footage,  they  all  may  have  increased  the  amount  of  office 
space  in  the  City  and  thus  increased  the  need  for  mass  transit.  For  these  reasons,  the 
department  should  have  referred  all  seven  projects  to  MUNI  for  its  determination. 

One  building  in  our  sample  of  seven  projects  that  the  department  did  not  refer  illustrates  a 
critical  flaw  in  the  department’s  process  for  identifying  buildings  that  may  be  subject  to 
the  transit  fee:  a building  can  change  its  use  completely,  yet  the  developer  need  not  pay  a 
transit  fee  if  applicants  take  out  a series  of  small  permits.  The  contractors  for  this 
building,  650  Townsend  Street,  applied  for  many  permits  using  two  addresses  over 
several  years.  These  applications  suggest  that  the  contractors  were  performing  major 
renovations  incrementally.  A commercial  plan  checker  for  the  department  and  a MUNI 
staff  person  acknowledge  that  this  building  has  changed  its  use  from  an  apparel  mart  to 
office  space,  but  the  developer  never  paid  the  transit  fee.  According  to  the  permit  clerks 
we  interviewed,  they  look  for  applications  that  indicate  office  space  will  increase  or  a 
building’s  use  will  change.  However,  the  site  permit  application  is  usually  the  only 
document  that  describes  the  overall  project,  while  subsequent  permits  for  a project,  such 
as  electrical  work,  seismic  upgrading,  or  tenant  improvements,  may  not  include 
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information  about  additional  space  or  a change  in  use.  After  we  showed  MUNI  the  seven 
projects  in  our  sample  that  the  department  had  failed  to  refer,  MUNI  found  that  two 
projects  were  not  subject  to  the  fee:  one  project  was  canceled,  and  the  other  converted  a 
building  into  a restaurant  rather  than  an  office.  However,  one  of  the  five  buildings  that 
MUNI  determined  was  subject  to  the  fee  is  650  Townsend  Street,  which  by  itself  may 
owe  over  one  million  dollars  in  transit  fees. 

The  Department's  Process  for  Referring 

Projects  to  MUNI  Has  Major  Flaws 

The  department's  process  for  referring  projects  to  MUNI  for  transit  fee  determinations  has 
serious  weaknesses  because  it  depends  too  heavily  on  the  experience  and  attention  of  the 
staff  involved,  and  the  process  does  not  include  up-to-date  written  procedures  that  remind 
the  staff  about  the  transit  fee.  When  department  clerks  receive  the  initial  application,  they 
must  notice  that  the  project  is  in  the  downtown  area,  as  defined  in  the  transit  fee 
ordinance,  and  that  the  project  may  increase  office  space  through  new  construction  or  by 
conversion  of  existing  space.  According  to  a permit  clerk  we  interviewed,  if  she  thinks  a 
project  will  increase  office  space,  she  tells  the  project  applicant  to  contact  MUNI,  and  she 
gives  the  applicant  a piece  of  paper  with  the  phone  number,  fax  number,  and  address  of 
the  contact  person  at  MUNI.  According  to  another  permit  clerk  at  the  department's 
Central  Permit  Bureau,  she  sometimes  sends  by  facsimile  to  MUNI  the  customers'  permit 
applications.  If  an  applicant  is  in  a hurry,  she  sometimes  processes  the  application  first 
and  informs  the  applicant  and  MUNI  that  the  fee  must  be  paid  later. 

The  process  described  to  us  includes  no  reminder  for  clerks  of  a building’s  transit  fee 
status.  Unless  the  applicant  offers  the  written  determination  he  or  she  received  from 
MUNI,  the  clerks  must  discern  from  the  permit  application  that  a project  may  be  subject 
to  the  fee.  There  is  no  written  policy  or  procedure  to  require  plan  checkers  to  refer 
projects  to  MUNI  if  they  notice  that  a project  will  create  office  space.  Furthermore,  when 
the  project  is  complete,  the  department  has  no  procedure  to  require  inspectors  to  check 
whether  the  developer  has  paid  the  transit  fee.  If  the  department  has  not  referred  to  MUNI 
a project  that  is  subject  to  the  fee,  MUNI  must  somehow  find  out  about  the  project  and 
notify  the  department’s  inspectors  to  withhold  a Certificate  of  Final  Completion  and 
Occupancy  until  the  developer  pays  the  fee.  Thus,  the  process  depends  solely  on  the 
clerks’  discretion  and  attention  when  permit  applications  are  filed  and  approved. 

Moreover  the  lack  of  adequate  procedures  and  systems  to  collect  the  transit  fee  suggests 
that  department  management  is  not  concerned  about  collecting  this  fee  even  though  the 
department  violates  the  administrative  code  when  it  issues  Certificates  of  Final 
Completion  and  Occupancy  without  evidence  that  developers  have  paid  the  required 
transit  fee.  Management  has  done  little  to  address  the  process. 

The  written  procedure  for  the  clerks’  handling  of  these  cases  is  outdated  because  it  relates 
to  a computer  system  the  department  no  longer  uses,  and  the  department  has  no  overall 
policy  explaining  to  staff  why  the  department  has  a role  in  collecting  a fee  that  benefits 
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another  city  department.  The  process  includes  no  control  points  involving  automation  or 
the  actions  of  managers.  The  previous  version  of  the  department’s  permit  tracking  system 
contained  a series  of  fields  into  which  the  clerks  entered  data  about  the  transit  fee 
determination.  According  to  a permit  clerk,  if  the  data  were  not  entered,  the  system  would 
not  process  the  application.  In  contrast,  the  current  system  will  let  the  user  continue  even 
if  the  status  field  for  the  transit  fee  is  blank.  Apparently,  supervisors  do  not  review  the 
clerks’  work  on  permit  applications  that  may  be  subject  to  the  fee,  and  the  department’s 
emphasis  on  customer  service  may  encourage  clerks  to  process  applications  promptly 
rather  than  to  spend  time  analyzing  whether  the  project  may  be  subject  to  a fee  owed 
another  department. 

Finally,  the  department  does  not  compile  permit  information  to  track  the  total  amount  of 
new  residential  or  commercial  space.  Thus,  neither  department  managers  nor  MUNI  can 
evaluate  the  department’s  effectiveness  in  referring  applications  appropriately. 


THE  DEPARTMENT  NEGLECTS  TO  NOTIFY  THE  SCHOOL 
DISTRICT  OF  SOME  PROJECTS  SUBJECT  TO  THE  SCHOOL  FEE 

In  failing  to  refer  some  projects  subject  to  the  school  fee  to  the  school  district,  the 
department  causes  the  school  district  to  lose  significant  revenue,  and  it  violates  state  law. 
Indeed,  the  loss  to  the  school  district  of  even  one  building’s  assessment  can  amount  to 
thousands  of  dollars  in  revenue.  Our  audit  disclosed  that  the  department  is  missing  some 
referrals  because  it  has  a manual  process  for  referring  projects  to  the  school  district,  and 
this  process  needs  improvement. 

When  the  department  receives  an  application,  a permit  clerk  notes  that  the  project  will 
increase  residential  or  commercial  space  in  the  City,  and  the  clerk  attaches  a form  and  its 
carbon  copy  to  the  application.  When  the  plan  checker  reviews  the  project,  he  or  she 
determines  the  increase  in  residential  or  commercial  square  footage  and  writes  that  figure 
on  the  form.  One  copy  of  the  form  remains  attached  to  the  application  until  the  school 
district  notifies  the  department’s  Central  Permit  Bureau  that  the  developer  paid  the  fee. 
The  applicant  takes  the  other  copy  to  the  school  district,  where  school  district  staff  uses 
the  square  footage  determination  to  calculate  the  fee  owed  for  the  project.  Residential 
development  is  assessed  at  $1.72  per  square  foot,  office  or  commercial  space  at  $0.24  per 
square  foot,  and  retail  or  service  space  at  $0.13  per  square  foot.  When  the  applicant  pays 
the  fee,  school  district  staff  stamps  the  form  and  sends  it  back  to  the  department  for  the 
permit  to  be  issued. 
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The  School  District  Can  Lose  Significant 
Revenue  When  Developers  Do  Not  Pay 
the  School  Fee 

The  fiscal  loss  to  the  school  district  from  the  department’s  failing  to  assess  the  school  fee 
on  even  one  building  can  be  significant.  Our  test  of  permit  records  for  increased 
nonresidential  space  showed  that  13  (65  percent)  of  20  projects  had  paid  the  school  fee,  2 
(10  percent)  of  the  projects  had  not  paid,  and  the  remaining  5 projects  were  still  under 
review  by  plan  checkers.  Of  the  2 nonresidential  projects  for  which  the  department  did 
not  assess  the  school  fee,  1 was  represented  by  a site  permit  application  submitted  in 
March  2000  to  erect  a 23-story  office  building  at  524  Howard  Street.  For  this  building, 
the  department  should  have  assessed  an  estimated  $48,472  for  the  school  fee.  If  the 
department  failed  to  assess  the  school  fee  on  other  projects,  as  is  likely,  the  school  district 
may  have  lost  hundreds  of  thousands  of  dollars  in  fee  revenue. 

The  Department  Violates  State  Law 
Because  It  Does  Not  Properly 
Assess  the  School  Fee 

The  department  violates  the  California  Education  Code  because  it  does  not  consistently 
identify  and  refer  to  the  school  district  before  issuing  building  permits  the  construction 
projects  that  are  subject  to  the  school  fee.  By  failing  to  withhold  a building  permit  for  a 
project  subject  to  the  school  fee  until  the  school  district  certifies  that  the  developer  has 
paid  the  fee,  the  department  violates  the  California  Education  Code,  Section  1 7620.  In 
addition,  the  department's  inconsistencies  in  referring  applications  to  the  school  district 
could  lead  to  a public  perception  that  the  department  does  not  treat  projects  equally. 

According  to  the  manager  of  the  Central  Permit  Bureau,  she  or  another  supervisor 
reviews  applications  for  large  new  buildings,  but  there  is  no  management  review  of  fees 
assessed.  In  addition,  a manager’s  review  will  not  necessarily  catch  all  errors  unless  the 
manager  is  thoroughly  familiar  with  the  applicable  requirements  and  exceptions  for  the 
school  fee  listed  in  the  Education  Code.  The  department’s  procedure  was  written  in  1987, 
and  some  staff  members  appear  unfamiliar  with  it.  Further,  the  procedure  is  outdated, 
incomplete,  or  both.  For  example,  it  does  not  mention  that  the  school  fee  applies  only  to 
residential  construction  that  increases  space  by  more  than  500  square  feet. 

Finally,  because  the  department  does  not  track  the  creation  of  new  residential  or 
commercial  space,  neither  it  nor  the  school  district  can  evaluate  the  department’s  rate  of 
success  in  referring  projects  to  the  school  district. 
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The  Department's  Process  for 
Referring  Projects  to  the  School 
District  Is  More  Effective  Than  Its 
Referral  Process  for  the  Transit  Fee 

Although  the  department  should  improve  its  procedures  for  assessing  the  school  fee,  our 
tests  revealed  that  the  rate  at  which  the  department  correctly  assesses  and  refers  projects 
subject  to  the  school  fee  (13,  or  87  percent,  of  15  nonresidential  projects  and  18,  or  90 
percent,  of  20  residential  projects)  is  significantly  higher  than  its  rate  of  referral  for  the 
transit  fee  (7,  or  54  percent,  of  projects).  We  also  found  that  the  department  processes 
permit  applications  differently  for  the  two  fees,  and  the  differences  may  account  for  the 
different  rates  of  success. 

For  the  transit  fee,  the  permit  clerks  refer  customers  to  MUNI  when  the  customers  file 
their  applications,  and  MUNI  determines  whether  the  applicants  owe  the  fee  and  how 
much  they  owe.  The  applicants  then  present  the  determinations  to  the  department’s 
permit  clerks  and  pay  to  MUNI  the  amounts  specified.  On  the  other  hand,  when  a 
customer  files  a permit  application  subject  to  the  school  fee,  department  staff  attaches  a 
form  to  the  application,  and  the  procedure  includes  three  opportunities  for  department 
staff  to  ensure  that  this  fee  is  paid:  Staff  verifies  the  payment  at  permit  filing,  plan 
checking,  and  permit  issuance.  The  attached  form  reminds  the  clerks  and  plan  checkers 
that  the  project  is  subject  to  the  school  fee.  Neither  system  works  as  consistently  as  it 
should,  and  managers  do  not  review  the  work  of  the  clerks  for  either  fee. 


THE  DEPARTMENT  SHOULD  IMPROVE  CONTROLS 
OVER  $1  PROJECT  VALUE  ESTIMATES  AND  ITS  REFERRAL 
TO  THE  FIRE  DEPARTMENT  OF  PERMIT  APPLICATIONS 

The  department  generally  uses  reasonable  estimates  of  the  value  of  construction  work, 
which  determines  the  amounts  of  many  permit  and  inspection  fees  that  the  department 
charges  its  customers.  However,  the  department  should  establish  a control  to  help  prevent 
the  possibility  of  abuse  when  staff  enters  $1  as  the  project  value  in  the  permit  tracking 
system.  Further,  the  department  should  more  consistently  follow  its  policy  for  referring  to 
the  San  Francisco  Fire  Department  the  applications  for  building  permits  so  that  Fire 
Department  personnel  can  review  the  fire  safety  features  of  all  proposed  projects.  Permit 
applicants  typically  provide  on  their  applications  the  value  estimates  for  work  they  are 
proposing.  Department  employees  can  change  the  estimated  value  if  they  believe  it  is 
unreasonable. 

The  department  bases  the  fees  charged  on  data  about  permit  applications  that  department 
staff  enters  in  the  permit  tracking  system.  This  information  includes  the  estimated  values 
of  the  projects  and  the  names  of  the  other  departments  that  must  review  the  applications. 
If  the  permit  clerk  enters  the  value  estimate  of  a project  correctly,  the  tracking  system 
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should  calculate  the  correct  permit  fees.  However,  we  found  no  procedure,  including  spot 
checks,  for  supervisors  to  review  plan  checkers’  assessments  of  value  estimates  provided 
by  customers  or  to  ensure  that  the  permit  fees  are  reasonable.  The  Central  Permit  Bureau 
manager  said  that  she  knew  of  no  management  review  of  fees. 

We  reviewed  the  department’s  reports  on  permits  issued  and  permits  filed  for  the  first 
half  of  June  2000.  Of  the  1,589  items  in  these  two  reports,  54  (3.4  percent)  appeared  to 
present  discrepancies.  However,  after  reviewing  documentation  on  the  54  permits,  we 
concluded  that  the  department  is  using  reasonable  value  estimates  for  work  proposed  in 
almost  all  cases. 

The  Department  Could  Better  Prevent  the 

Possibility  of  Abuse  When  Staff  Enters  in  the 

Database  $1  as  the  Value  for  Work  to  Be  Performed 

Although  the  department  generally  uses  reasonable  estimates  of  project  value  to  calculate 
permit  fees,  its  review  and  referral  process  for  permit  applications  appears  to  have  a few 
weaknesses.  Specifically,  for  4 (7  percent)  of  the  54  applications  we  reviewed  in  detail, 
the  department’s  permit  tracking  system  showed  $1  as  the  estimated  value  for  each 
project,  an  amount  that  appears  unreasonably  low.  Staff  in  the  Central  Permit  Bureau 
explained  that  it  enters  this  amount  into  the  system  when  the  permit  application  simply 
revises  plans  for  work  approved  under  an  earlier  permit  and  does  not  increase  the  value  of 
the  work  originally  proposed.  Department  staff  enters  $1  as  the  value  of  work  so  that  the 
permit  tracking  system  does  not  calculate  and  require  additional  permit  fees  that  would 
duplicate  those  the  applicant  has  already  paid.  However,  the  practice  of  using  $1  as  the 
value  of  work  increases  the  possibility  that  staff  could  abuse  this  feature  of  the  system  to 
enter  fraudulently  low  values  for  projects  so  that  permit  applicants  could  pay  permit  fees 
that  are  lower  than  those  required. 

However,  the  practice  of  entering  $1  as  the  value  of  a proposed  project  does  not  indicate 
that  the  department  assesses  permit  fees  incorrectly.  In  addressing  the  department’s 
controls  over  whether  it  generally  arrives  at  reasonable  value  estimates,  the  former  deputy 
director  for  permit  services  stated  that  plan  checkers  use  a standardized  table  to  assess 
building  valuations,  especially  for  new  construction,  to  ensure  that  permit  fees  are 
correct.  He  also  stated  that  plan  checkers  use  their  judgment  to  assess  whether  valuations 
are  reasonable  and  that  other  permit  services  staff  see  the  valuations  and  would  identify 
any  that  were  unreasonable  for  the  work  to  be  performed.  He  added  that  building 
inspectors  also  provide  a check  on  this  system  when  they  inspect  the  project  as  it  is  built. 
Nevertheless,  the  department  has  no  procedure  that  requires  plan  checkers,  permit  issuers, 
or  inspectors  to  check  whether  a project  with  a $1  or  other  low  estimated  value  has  an 
earlier  permit  under  which  all  fees  were  paid. 
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The  Department  Should  More  Consistently 
Follow  Its  Policy  for  Referring  Building 
Permit  Applications  to  the  Fire  Department 

Of  the  54  items  we  identified  in  the  department's  reports  on  permits  issued  and  filed 
during  the  first  half  of  June  2000,  3 (6  percent)  were  permit  applications  that  the 
department  should  have  but  did  not  refer  to  the  Fire  Department.  According  to  the 
department’s  policy  for  such  referrals,  the  department  should  have  referred  these 
applications.  Although  the  3 applications  represent  only  a few  among  many,  the  risk 
inherent  in  fire  safety  issues  demands  that  the  department  follow  its  referral  policy  in  all 
cases.  The  department's  inconsistency  in  allowing  trained  staff  from  the  Fire  Department 
to  scrutinize  fire  safety  features  of  buildings  could  suggest  a serious  lack  of  oversight  by 
the  Department  of  Building  Inspection. 


RECOMMENDATIONS 

To  allow  the  Municipal  Railway  and  the  San  Francisco  Unified  School  District  to  collect 

more  effectively  the  fees  owed  to  them  and  to  better  control  how  it  assesses  permit  fees 

and  reviews  permit  applications,  the  Department  of  Building  Inspection  should  take  these 

steps: 

• Update  its  policies  so  that  the  department  clearly  communicates  to  all  Permit  Services 
Program  staff  its  responsibilities  for  the  Transit  Impact  Development  Fee  and  the 
School  Facility  Impact  Fee. 

• Revise  its  current  procedures,  particularly  those  related  to  its  permit  tracking  system. 

• Develop  a procedure  to  track  incremental  changes  to  buildings  so  proposed 
construction  projects  that  change  a building’s  use  or  that  increase  square  footage  can 
be  referred  appropriately. 

• Establish  in  the  permit  tracking  system  an  automated  reminder  for  staff  to  verify  the 
status  of  fee  payments.  This  reminder  could  appear  when  the  department  is  ready  to 
issue  to  a developer  the  Certificate  of  Final  Completion  and  Occupancy. 

• Ensure  that  supervisors  for  the  Permit  Services  Program  spot-check  permit 
applications  regularly  to  see  that  clerks  are  referring  applications  appropriately  to  the 
San  Francisco  Municipal  Railway  and  the  San  Francisco  Unified  School  District. 

• Add  a field  to  the  permit  tracking  system  that  would  require  staff  to  indicate  any 
previous  permit  numbers  for  permit  applications  that  are  renewals  or  revisions  of 
other  permits  and  that  do  not  require  the  usual  fees.  An  entry  in  this  field  would  allow 
the  system  to  waive  the  additional  fees  that  the  department  would  otherwise  assess, 
and  the  entry  would  clearly  identify  why  the  applicant  does  not  owe  the  usual  fees. 
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• Make  certain  that  the  department  is  implementing  a process  that  ensures  that  the 
Permit  Services  Program  refers  cases  to  the  San  Francisco  Fire  Department  according 
to  the  department's  procedure.  The  department  should  revise  this  referral  procedure  if 
necessary. 
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CHAPTER  3 

THE  DEPARTMENT  SHOULD  IMPROVE  SOME  PERSONNEL 
AND  FLEET  MANAGEMENT  PRACTICES 

CHAPTER  SUMMARY 

Because  the  Department  of  Building  Inspection  (department)  has  not  adequately 

recorded  or  monitored  employee  certification,  training,  or  evaluation,  it  cannot  be 
certain  that  it  is  complying  with  state  law  or  that  its  employees  receive 
appropriate  evaluations  of  their  performance  from  their  managers.  In  fact,  25  percent  of 
department  employees  required  by  state  law  to  earn  certification  may  not  have  done  so. 
Consequently,  the  department  is  exposing  the  City  and  County  of  San  Francisco  (City)  to 
legal  liability  because  the  department  has  no  policies  or  procedures  that  allow  it  to  show 
that  staff  has  proper  certification  and  training.  Additionally,  unless  department  employees 
achieve  certification  and  fulfill  continuing  education  requirements,  they  may  not  be 
staying  abreast  of  developments  and  techniques  in  their  fields  that  would  allow  them  to 
perform  their  jobs  as  proficiently  as  possible. 

Indeed,  most  of  the  department’s  129  employees  we  surveyed  report  that  they  have  not 
received  performance  evaluations  in  more  than  a year,  and  19  percent  of  129  employees 
responding  to  a survey  we  conducted  said  that  they  have  never  been  evaluated.  According 
to  the  City's  Department  of  Human  Resources,  departments  should  evaluate  their 
employees  at  least  annually.  Without  documentation  about  their  job  performance, 
employees  do  not  know  whether  they  are  fulfilling  their  responsibilities  adequately. 

Further,  the  department  does  not  keep  sufficient  records  to  ensure  that  it  reports  the 
unpaid  car  benefit  that  federal  law  requires  the  City  to  apply  to  all  employees  who  drive 
city  cars  home  at  night.  Our  review  showed  that  the  department  did  not  report  this  benefit 
for  more  than  half  of  the  employees  who  receive  it.  Finally,  the  department  does  not  have 
adequate  procedures  to  manage  its  vehicle  fleet. 


BACKGROUND 

According  to  the  California  Health  and  Safety  Code,  Section  18949.28,  all  construction 
inspectors,  plan  examiners,  and  each  local  agency’s  building  official  must  obtain 
professional  certification  from  a recognized  state,  national,  or  international  association  as 
determined  by  the  local  agency.  In  addition,  certification  must  be  obtained  within  two 
years  of  hire  by  the  department.  Thus,  all  plan  checkers  and  all  building,  plumbing,  and 
electrical  inspectors  are  subject  to  the  code.  The  department's  director  may  also  be 
subject  to  this  regulation  because  the  code  further  states  that  a building  official  is 
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“the  individual  invested  with  the  responsibility  for  overseeing  local  code  enforcement 
activities,  including  administration  of  the  building  department,  interpretation  of  code 
requirements,  and  direction  of  the  code  adoption  process.”  In  addition,  the  code  states  that 
employees  working  for  the  department  on  or  before  January  1,  1994,  are  exempt  from  the 
certification  requirement  and  those  who  began  working  after  that  date  are  subject  to  it. 

The  same  section  of  state  law  also  requires  that  all  construction  inspectors,  plan 
examiners,  and  the  department’s  building  official  regardless  of  hire  date-complete  a 
minimum  of  45  hours  of  continuing  education  every  three  years.  The  law  states  that 
providers  of  continuing  education  may  be  any  organization  affiliated  with  the  code 
enforcement  profession,  a community  college,  or  any  other  provider  of  training  that  has 
similar  quality,  as  determined  by  the  local  agency.  The  law  defines  this  continuing 
education  to  include  any  education  on  the  enforcement  of  Title  24  of  the  California  Code 
of  Regulations  and  any  other  locally  enforced  building  and  construction  standards. 

THE  DEPARTMENT  MUST  ENSURE  THAT  ITS  EMPLOYEES  HAVE 
PROFESSIONAL  CERTIFICATION 

The  department  does  not  adequately  ensure  that  its  employees  have  earned  the 
professional  certification  required  by  law.  The  department  has  no  policy  or  procedure  for 
monitoring  the  professional  certification  status  of  its  employees,  and  it  does  not  maintain 
adequate  records  of  their  certification  status.  Without  this  monitoring  and  record  keeping, 
the  department  cannot  know  the  extent  of  its  compliance  with  the  certification 
requirement  now  or  in  the  future. 

In  December  2000,  at  our  request,  the  department  sought  documentation  of  certification 
directly  from  employees  subject  to  the  requirement.  In  examining  the  documentation,  we 
found  that  6 of  24  department  employees  who  we  believe  were  required  by  law  to  possess 
professional  certification  had  not  earned  this  certification.  The  professional  competence 
of  the  department’s  employees  could  be  questioned,  and  the  department  could  be  subject 
to  legal  action  from  a dissatisfied  customer  or  others  if  some  employees  who  should  be 
certified  have  not  completed  this  process. 

Twenty-five  Percent  of  the  Department’s 

Employees  Who  Need  to  Earn  Certification 

May  Not  Have  Done  So 

Although  we  found  that  most  of  the  department's  employees  who  should  be  certified  were 
certified,  some  employees  had  not  completed  the  certification  process  by  the  end  of  2000. 
For  the  24  employees  we  identified  as  requiring  certification,  the  Personnel  Services 
Division  was  able  to  collect  documentation  for  us  showing  that  18  (75  percent)  were 
certified,  2 (8  percent)  were  not  certified,  and  4 (17  percent)  provided  no  information.  In 
addition,  of  the  1 8 who  were  certified,  3 had  not  obtained  certification  by  the  date 
required  by  law. 
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The  Department's  Record 
Keeping  Is  Deficient 

The  department's  Personnel  Services  Division  was  able  to  provide  us  with  only  partial 
records  of  employee  certification.  In  November  1995,  the  department  director  sent  a 
memorandum  to  deputy  directors  and  division  chiefs  summarizing  the  provisions  of  the 
state  law  requiring  certification  and  continuing  education  credits  for  construction 
inspectors,  plan  checkers,  and  building  officials.  Although  the  memorandum  requested 
that  deputy  directors  and  division  chiefs  provide  the  names,  classifications,  and  hiring 
dates  of  the  employees  affected,  the  Personnel  Services  Division  did  not  have  this 
information  on  file.  To  determine  which  department  employees  must  be  certified,  the 
Personnel  Services  Division  had  to  research  employee  hire  dates  through  the  City’s 
Department  of  Human  Resources.  According  to  the  Personnel  Services  Division  manager, 
the  division  does  not  maintain  records  of  employee  hire  dates. 

In  the  past  year,  according  to  the  director  of  the  Personnel  Services  Division,  staff  had 
contacted  employees  requesting  that  they  report  on  their  certification  status.  However,  the 
information  it  received  did  not  include  documentation  to  support  employees’  claims  that 
they  had  been  certified  or  to  show  that  the  employees  surveyed  were  those  required  by 
law  to  be  certified. 

The  Department  Has  No  Policies  or  Procedures 
For  Verifying  Certification  of  Employees 

The  department  lacks  a policy  or  procedure  for  making  certain  that  all  appropriate  staff 
obtains  certification.  Further,  we  found  no  departmental  policy  or  procedure  regarding 
professional  certification  that  adequately  describes  the  law's  requirements,  the 
department’s  responsibilities  under  the  law,  ways  to  identify  employees  who  require 
certification,  and  a process  by  which  the  department  can  collect  and  monitor  employee 
certification  information. 

Although  the  director’s  1995  memorandum  began  a process  of  verifying  certification  by 
compiling  relevant  employee  data,  it  did  not  establish  a procedure  to  monitor  compliance 
continuously.  Another  memorandum,  written  by  a senior  housing  inspector  in  March 
1998  to  the  department’s  senior  managers,  summarizes  the  provisions  of  the  law\  The 
memorandum  also  describes  a certification  program  of  the  International  Conference  of 
Building  Officials  and  provides  information  about  an  exam  that  took  place  in  June  1998. 
The  memorandum  states  that  the  department  would  pay  for  the  cost  of  the  exam. 
However,  we  found  no  evidence  that  the  department  acted  in  response  to  this  information. 

The  department  could  more  effectively  monitor  employee  certification  if  the  department 
established  a policy  describing  specifically  which  employees  must  earn  certification.  The 
law  is  clear  that  plan  checkers  and  building  inspectors  require  certification,  but  senior 
managers  do  not  fall  into  these  job  categories.  However,  managers  in  the  Permit  Services 
and  Inspection  Services  Divisions  oversee  the  work  of  their  staff  and  must  be  fully 
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capable  of  plan  review  and  inspection  work  to  supervise  their  staff  effectively.  For  this 
reason,  we  believe  that  the  department  should  require  managers,  including  the 
department’s  director,  to  be  subject  to  the  same  certification  requirements  as  their  staff. 


THE  DEPARTMENT  MAY  NOT  BE  COMPLYING 
WITH  STATE  TRAINING  REQUIREMENTS 

The  department  does  not  maintain  adequate  records  and  has  no  policy  or  procedure  to 
monitor  the  continuing  professional  education  of  its  staff.  Consequently,  the  department 
cannot  be  certain  that  it  complies  with  the  requirement  in  state  law  that  all  construction 
inspectors,  plan  checkers,  and  the  department’s  building  official  complete  at  least  45 
hours  of  continuing  education  every  three  years.  Unlike  the  requirement  for  certification, 
this  provision  pertains  to  the  affected  employees  regardless  of  their  hiring  dates.  If  they 
do  not  fulfill  continuing  education  requirements,  department  employees  may  not  stay 
current  with  developments  and  techniques  in  their  fields  that  will  allow  them  to  perform 
their  jobs  proficiently. 

We  requested  that  department  managers  give  us  documentation  for  those  employees  who 
were  required  to  complete  continuing  education  classes  for  the  1998-2000  period.  The 
documentation  we  received  indicated  that  only  42  percent  of  all  employees  had  some 
training  during  the  period.  According  to  the  Administration  and  Finance  Division 
manager,  the  department  has  no  policy  or  procedure  for  tracking  employees’  continuing 
education  classes,  but  the  department  is  beginning  to  develop  a process  to  collect  this 
information. 

Of  the  six  managers  of  divisions  or  units  from  whom  we  requested  information,  none  had 
maintained  records  to  show  that  all  employees  in  his  or  her  division  or  unit  had 
completed  at  least  45  hours  of  training  for  any  three-year  period.  Only  one  division  had 
maintained  records  for  its  employees,  but  these  records  covered  only  the  training  that 
took  place  during  2000.  Also,  we  could  not  determine  if  any  of  the  training  listed  in  the 
information  given  to  us  would  meet  the  law's  requirements  for  continuing  professional 
education  because  the  department  has  no  standards  or  criteria  specifying  the  types  of 
training  that  count  toward  fulfilling  the  requirements. 

Not  only  have  they  failed  to  monitor  employees’  continuing  education,  but  some 
department  managers  have  also  demonstrated  that  they  may  not  understand  the  law’s 
requirements  fully.  For  example,  one  manager  indicated  that  he  thought  employees  who 
had  worked  for  the  department  for  a certain  amount  of  time  were  exempt,  and  another 
manager  indicated  that  staff  members  should  determine  if  they  want  training.  Because 
records  were  incomplete  and  the  department  does  not  maintain  adequate  records  of 
continuing  education,  we  could  not  assess  the  status  of  any  employee’s  compliance  with 
the  law. 
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THE  DEPARTMENT  SHOULD  BETTER  ENSURE  THAT 
ITS  EMPLOYEES  RECEIVE  EVALUATIONS  REGULARLY 


Of  129  department  employees  we  surveyed,  78  (60  percent)  indicated  that  they  had  not 
received  a performance  evaluation  within  the  past  year.  The  City’s  Department  of  Human 
Resources  suggests  that  city  departments  conduct  employee  performance  appraisals  at 
least  annually.  We  did  not  review  the  department’s  personnel  records  to  determine  the 
frequency  with  which  employees  have  received  performance  evaluations.  However,  in  the 
survey  of  employees  we  discuss  in  Chapter  5,  we  asked  employees  approximately  when 
they  received  their  most  recent  performance  appraisal.  Only  51  (40  percent)  of  those 
surveyed  stated  they  had  received  a performance  evaluation  in  the  past  year.  In  addition, 
53  (41  percent)  of  the  respondents  stated  that  they  had  received  their  last  performance 
evaluation  from  more  than  one  year  to  more  than  five  years  ago.  The  remaining  25 
respondents  (19  percent)  stated  that  they  had  never  received  a performance  evaluation. 
Some  of  those  who  had  not  had  a performance  evaluation  in  the  last  year  may  have  been 
recently  hired  and  were  not  yet  due  for  an  evaluation  at  the  time  of  the  survey. 

The  department’s  assistant  director  acknowledged  that  employees’  performance  should  be 
measured  more  regularly.  She  also  noted  that  evaluations  should  be  more  consistent 
because  the  department  measures  the  performance  of  senior  staff  more  regularly  than  it 
evaluates  the  performance  of  lower-level  employees. 

Without  documentation  about  their  job  performance,  employees  do  not  know  whether 
they  are  fulfilling  their  responsibilities  sufficiently.  Inevitably,  the  department’s  staff  has 
less  direction  and  accountability  than  it  would  if  performance  appraisals  were  in  place. 
The  Handbook  for  Employees  of  the  City  and  County  of  San  Francisco  (August  1998, 
p.14)  offers  the  following  description  of  the  City’s  evaluation  system  for  employees: 

The  purpose  of  the  performance  appraisal  system  is  to  ensure  that  employees 
understand  the  duties  and  responsibilities  for  which  they  are  being  held 
accountable,  evaluate  employees  on  their  performance,  identify  training  needs, 
improve  effectiveness,  provide  a basis  for  career  development  and  assure  quality 
service  to  the  public.  The  system  is  an  essential  tool  for  managerial  decision- 
making, [and]  assists  in  overall  communications. 

THE  DEPARTMENT  DOES  NOT  ADEQUATELY  REPORT 
THE  UNPAID  CAR  BENEFIT  FOR  ITS  EMPLOYEES  OR 
SUFFICIENTLY  MANAGE  ITS  CITY  VEHICLES 

Besides  seeing  that  its  employees  are  adequately  certified,  trained,  and  evaluated,  the 
department  must  ensure  that  it  reports  to  the  Internal  Revenue  Service  the  unpaid  car 
benefit  for  all  employees  who  receive  it.  In  addition,  the  department  needs  to  strengthen 
its  management  controls  over  its  fleet  vehicles.  The  department  does  not  report  the  unpaid 
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car  benefit  for  more  than  half  of  the  91  employees  who  receive  the  benefit.  Furthermore, 
the  department  has  no  written  policy  for  determining  the  assignments  of  city  cars  to 
drivers  or  parking  spaces. 

Most  of  the  Department’s  Drivers 

Who  Use  City  Cars  Are  Not  Taxed 

According  to  Federal  Law 

The  department  violates  federal  tax  law  by  failing  to  report  the  unpaid  but  taxable  car 
benefit  tax  from  more  than  half  of  the  91  employees  who  drive  city  cars  home  at  night. 
Central  Shops,  which  assigns  and  services  most  city  vehicles,  assigned  115  city  cars  to 
the  department  for  use  by  department  employees.  The  department  has  use  of  a nearby 
parking  lot  in  which  it  parks  some  cars  at  night.  Department  employees  who  live  in  San 
Francisco  park  the  remaining  cars  at  their  homes  at  night  and  use  them  to  commute  to 
work.  We  found  that  the  department  reports  the  night  use  of  only  39  (43  percent)  of  the 
91  cars  that  go  home  with  department  employees,  and  it  fails  to  report  the  use  of  52  cars 
(57  percent).  The  Controller’s  Special  Pay  Usage  Report  shows  that  41  department 
employees  had  a $3  per  day  unpaid  car  benefit  reported  on  their  paychecks  in  the  pay 
period  ending  January  5,  2001;  however,  the  department  does  not  list  2 of  these 
employees  as  night  drivers. 

Under  federal  tax  law,  if  employees  use  their  employer’s  cars  to  commute,  employers 
report  this  use  as  a taxable  fringe  benefit  included  in  employee  income.  Employees’  use 
of  these  cars  to  commute  to  and  from  work  is  considered  personal  use  and  valued  at  $1 .50 
per  trip  or  $3.00  per  day. 

The  San  Francisco  Administrative  Code  Section  4.1 1 permits  commuting  in  city  cars  by 
on-call  employees  and  other  employees  under  limited  circumstances,  including  for  the 
sole  purpose  of  garaging  the  vehicle  at  the  employee’s  residence.  In  such  cases,  the 
department  head  must  determine  that  the  public  interest  is  best  served  by  permitting  the 
employee  to  take  the  car  home  rather  than  by  the  City’s  garaging  it.  The  Board  of 
Supervisors  must  approve  these  decisions  upon  recommendation  by  the  director  of 
administrative  services.  According  to  the  department's  Administration  and  Finance 
manager,  the  department  obtained  approval  from  the  Board  of  Supervisors  sometime 
before  1996  when  the  department  was  known  as  the  Bureau  of  Building  Inspection  within 
the  Department  of  Public  Works. 

The  Personnel  Services  manager  keeps  the  Special  Pay  Usage  Report  records  for  unpaid 
car  benefits,  but  the  Administration  and  Finance  manager  keeps  the  records  for  car 
assignments.  Our  review  indicated  that  these  records  do  not  receive  regular  reconciliation. 
Inconsistently  reporting  these  benefits  violates  federal  tax  law  and  puts  the  City  at  risk  of 
sanctions  by  the  Internal  Revenue  Service. 
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The  Department  Assigns  Cars  to  Some  Employees 
Who  May  Not  Need  Them  Every  Day 

According  to  the  Administration  and  Finance  manager,  the  department’s  unofficial  policy 
is  for  inspectors  and  other  personnel  who  need  city  cars  during  the  day  to  use  the 
vehicles,  but  we  were  unable  to  determine  how  many  employees  use  cars  during  the  day. 
Further,  the  department  does  not  keep  current  its  assignment  records.  Each  inspector 
needs  a car  daily,  and  89  (88  percent)  of  assigned  cars  are  assigned  to  the  Inspection 
Services  Program.  However,  12  (12  percent)  of  the  assigned  cars  are  assigned  to  other 
units:  1 1 to  managers  and  members  of  noninspection  units  and  one  to  the  Building 
Inspection  Commission,  which  has  a secretary  who  takes  this  vehicle  home  at  night.  The 
department’s  director  is  assigned  a car,  and  each  unit  of  the  Permit  Services  Program  has 
one  car  assigned  to  it.  The  exceptions  are  the  Mechanical  Plan  Check  Division,  which 
receives  no  assigned  vehicles,  and  the  One-Stop  Permit  Coordination  unit,  which  receives 
four. 


The  Department  Does  Not  Have  a 
Policy  for  Assigning  Its  Fleet  Vehicles 

The  department  does  not  have  a policy  covering  how  it  should  assign  city  cars  to 
employees  and  when  it  should  garage  cars  at  the  department  overnight.  The  department 
has  no  set  number  of  parking  spaces  available  for  overnight  use  and  no  policy  for 
determining  car  assignments.  At  the  time  of  our  audit,  91  of  the  department’s  employees 
drove  city  cars  home  at  night,  and  the  department  had  assigned  23  additional  cars  to  park 
overnight  in  a lot  near  the  department.  The  department  appears  to  assign  cars  to  night 
drivers  as  its  option  of  first  resort  and  then  park  extra  cars  in  the  lot.  Assigning  cars  to 
night  drivers  who  are  not  on-call  employees  when  overnight  parking  space  is  available 
adds  unnecessary  mileage  and  wear  to  city  cars. 

We  also  found  that  the  department’s  records  of  car  assignments  should  be  more  current. 
According  to  the  department's  administration  and  finance  manager,  the  assignment  of  cars 
changes  frequently.  Because  other  department  personnel  do  not  communicate  changes 
promptly,  she  updates  the  records  about  every  two  to  three  months.  However,  without 
more  current  records  of  which  employees  take  cars  home  at  night,  the  department  cannot 
correctly  assess  the  unpaid  car  benefit. 
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RECOMMENDATIONS 


To  better  monitor  employee  certification,  training,  and  evaluations  and  to  comply  with 

state  law,  the  Department  of  Building  Inspection  should  do  the  following: 

• Develop  a policy  regarding  professional  certification  and  training  of  employees  that 
details  the  legal  requirements  for  training,  the  affected  employees  (including 
managers),  and  the  acceptable  types  of  training.  This  policy  should  also  state 
consequences,  such  as  reassignment  or  administrative  leave,  for  those  employees  who 
do  not  comply  with  the  requirements  within  a stated  time. 

• Establish  a procedure  specifying  how  the  department  will  collect  and  maintain 
employee  certification  and  training  information.  This  procedure  should  also  outline 
how  the  department  will  enforce  training  and  certification  requirements.  Maintain 
records  of  employees’  hire  dates  to  determine  who  must  earn  certification  and  aid  in 
scheduling  employee  evaluations. 

• Ensure  that  all  employees  receive  performance  evaluations  at  least  annually.  The 
department’s  Personnel  Services  Division  should  provide  guidance  to  managers  in 
administering  performance  evaluations.  The  division  should  also  record  when 
performance  evaluations  for  every  employee  are  due  so  that  it  can  notify  the 
appropriate  managers. 

• Make  certain  that  managers  who  assign  cars  maintain  clear,  current  records  of 
assignments  and  communicate  these  assignments  promptly  to  personnel  managers  so 
that  the  unpaid  car  benefit  is  reported  properly  to  the  Internal  Revenue  Service. 

• Develop  and  enforce  a detailed  policy  regarding  the  use  of  city  vehicles.  To  comply 
with  the  provisions  of  the  City's  administrative  code,  the  policy  should  include  a 
discussion  of  how  the  public  interest  is  best  served  by  the  proposed  policy.  The 
Building  Inspection  Commission  and  the  director  of  administrative  services  should 
approve  this  policy  and  then  recommend  it  to  the  Board  of  Supervisors. 

• Use  available  garage  or  lot  spaces  before  it  allows  personnel  who  are  not  on  call  to 
take  cars  home  at  night. 

• Consider  creating  a pool  of  cars  for  use  by  those  who  do  not  travel  daily. 

• Analyze  its  overall  vehicle  needs  to  ensure  that  it  has  an  appropriate  number  of  city 

cars. 
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CHAPTER  4 

THE  DEPARTMENT  USES  INEFFICIENT,  UNRELIABLE 
PROCESSES  FOR  RECORDING  AND  REPORTING 
INFORMATION  ON  ITS  PRODUCTIVITY  AND  PROMPTNESS 


CHAPTER  SUMMARY 

The  Department  of  Building  Inspection  (department),  and  especially  its  Plan  Check 
Services  unit,  relies  too  heavily  on  manual  processes  to  compile  its  performance 
statistics.  These  processes  are  unnecessarily  time-consuming  and  subject  to  error. 
Because  the  resulting  statistics  are  the  department's  primary  means  for  determining 
whether  its  employees  are  productive,  inaccurate  figures  could  present  a misleading 
picture  of  the  department’s  performance.  Without  accurate  performance  statistics, 
department  management  and  city  decision  makers  cannot  be  sure  that  the  department  is  as 
efficient  as  it  reports.  Moreover,  staff  members  are  spending  unnecessary  amounts  of 
time  tabulating  statistics  that  computerized  systems  could  calculate  more  quickly  and 
accurately. 

Further,  the  productivity  results  the  department  reports  for  its  building  inspectors  appear 
to  be  overstated.  Although  the  reports  on  the  promptness  of  building  inspections  are 
accurate,  the  records  on  building  inspections  and  the  resulting  reports  on  the  level  of 
inspector  productivity  show  inflated  figures.  This  situation  has  occurred  because  the 
department's  Building  Inspection  Division  counts  as  inspections  some  of  the  building 
inspectors’  other  activities  and  some  responsibilities  that  are  not  activities  at  all.  Finally, 
the  Housing  Inspection  Services  Division  should  improve  its  reporting  of  performance 
results  and  its  record  keeping,  particularly  of  how  housing  inspectors  spend  their  time  on 
code  enforcement  cases,  and  it  should  establish  performance  goals  that  better  reflect  its 
objective  to  see  that  code  violations  are  corrected. 


THE  DEPARTMENT’S  CALCULATION  OF 
PERFORMANCE  STATISTICS  IS  INEFFICIENT 
AND  POTENTIALLY  INACCURATE 

The  department,  and  especially  the  Plan  Check  Services  unit,  generally  uses  manual 
methods  of  calculating  performance  statistics  that  are  unnecessarily  time-consuming  and 
subject  to  error.  The  amount  of  manual  labor  involved  in  the  reporting  process 
unnecessarily  occupies  staff  with  tasks  that  do  not  directly  contribute  to  the  fulfillment  of 
the  department’s  mission  and  that  reduce  the  time  they  have  available  to  serve  customers 
or  to  support  other  staff  who  deal  with  customers.  Moreover,  these  calculation  methods 
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caused  the  department  to  report  some  statistics  that  are  inaccurate  and  erroneously 
showed  that  the  department  had  met  certain  performance  goals. 

Employees  appear  to  recognize  that  the  department  could  use  automated  methods  to 
increase  efficiency.  In  our  survey  of  employees,  1 10  (82  percent)  of  134  respondents 
agreed  that  greater  use  of  computers  and  other  technology  would  improve  the 
department’s  productivity. 

Some  Performance  Statistics 
of  the  Plan  Check  Services  Unit  Are 
Inaccurate  or  Cannot  Be  Verified 

We  tested  selected  performance  statistics  for  three  of  the  four  divisions  of  the  Plan  Check 
Services  unit  and  found  that  two  of  the  three  divisions  reported  some  performance 
statistics  that  are  inaccurate,  and  the  third  reported  statistics  that  we  could  not  test  for 
accuracy.  We  tested  selected  productivity  and  response-time  results  of  the  Commercial 
Plan  Check,  Residential  Plan  Check,  and  Major  Projects/Unreinforced  Masonry  Building 
(Major/UMB)  divisions  that  appear  in  the  department’s  report  for  the  first  quarter  of 
fiscal  year  1 999-2000. 

We  found  that  the  Commercial  Plan  Check  Division  calculated  its  response-time  and 
productivity  statistics  correctly  based  on  data  in  the  department's  permit  tracking  system. 
However,  the  division  could  not  provide  daily  reports  for  the  month  we  tested.  As  a 
result,  we  could  not  verify  the  accuracy  of  the  reported  quarterly  results. 

The  Residential  Plan  Check  Division  incorrectly  stated  in  the  quarterly  report  that  it  had 
met  all  its  performance  goals.  In  reviewing  the  results,  we  calculated  that  this  division  fell 
3 percent  short  of  meeting  its  goal  for  permits  approved  within  seven  days:  The  division 
approved  87  percent  of  permit  applications  rather  than  the  reported  90  percent.  In 
addition,  in  calculating  productivity  statistics,  the  Residential  Plan  Check  Division 
appears  to  have  used  an  incorrect  number  of  hours  spent  by  plan  checkers.  According  to 
our  review  of  daily  reports  for  August  1 999,  which  was  one  month  during  the  quarter, 
plan  checkers  worked  37  more  hours  than  the  number  used  by  the  department  in  the 
calculation. 

The  Major/UMB  Plan  Check  Division  uses  a faulty  method  of  calculating  the  percentage 
of  permits  approved  within  90  days.  Because  it  counts  permits  that  take  as  long  as  120 
days  for  approval  as  having  received  approval  within  90  days,  this  division  incorrectly 
stated  that  it  had  approved  86  percent  of  its  permit  applications  within  90  days,  thereby 
meeting  its  performance  goal  of  75  percent  for  the  quarter.  We  found  that  the 
Major/UMB  Plan  Check  Division  actually  approved  only  64  percent  of  the  permits  it 
reviewed  within  90  days,  and  this  amount  was  1 1 percent  below  its  goal  for  the  quarter. 
Without  accurate  response-time  statistics  for  this  unit,  department  management  cannot 
adequately  gauge  the  success  of  this  key  function  of  the  department. 
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The  Department  Relies  on 
Inefficient  Calculations  That 
Could  Be  Erroneous 

Not  only  does  the  department  rely  on  a faulty  method  to  calculate  some  performance 
statistics,  but  it  also  uses  a manual  system  for  calculating  and  compiling  the  response- 
time and  productivity  statistics  it  includes  in  monthly  and  quarterly  reports.  This  method 
for  collecting  data  is  more  time-consuming  and  introduces  more  possibility  for  human 
error  than  does  an  automated  method.  The  system  is  also  inefficient  because  it  requires 
duplicate  data  entry  and  duplicate  calculations  by  those  who  do  the  work  and  those  who 
keep  track  of  the  data. 

The  monthly  reports  that  we  tested  from  the  various  inspection  divisions  were  accurate. 
However,  the  Plan  Check  Services  unit  has  moved  away  from  automated  calculations  of 
its  performance  data  and  toward  manual  methods  that  its  staff  knows  are  inefficient. 
According  to  the  principal  clerk  who  prepares  the  unit’s  performance  data,  when  the 
department  switched  from  the  previous  version  of  the  permit  tracking  system  to  the 
current  version  in  January  2000,  it  experienced  problems  with  inaccurate  data. 
Consequently,  the  unit  began  relying  more  on  manual  methods  to  produce  subsequent 
reports. 

According  to  a senior  business  analyst  and  a consultant  to  the  Management  Information 
Services  Division,  the  department's  line  staff  does  not  take  full  advantage  of  the  permit 
tracking  system’s  script- writing  capability.  If  plan  checkers  and  inspectors  directly 
entered  selected  activity  data  into  the  Permit  tracking  system,  support  staff  in  these  units 
could  execute  statistical  management  reports  with  a few  keystrokes  on  their  computers. 


THE  BUILDING  INSPECTION  DIVISION 
OVERSTATES  ITS  PRODUCTIVITY 

Although  inspectors’  daily  records  support  the  figures  for  response-time  and  total 
building  inspections  that  the  department  reports,  the  department  is  unintentionally 
inflating  the  number  of  building  inspections  because  the  Building  Inspection  Division 
counts  as  inspections  some  other  activities  performed  by  the  building  inspectors  and 
some  categories  of  a project’s  status  that  are  not  activities.  Some  of  these  activity 
categories  clearly  do  not  constitute  inspections,  and  it  is  unclear  if  others  may  qualify  as 
inspections.  The  department  allows  building  inspectors  to  record  all  such  activities  on 
their  daily  reports.  Because  these  methods  lead  to  inaccurate  performance  statistics, 
department  management  cannot  rely  on  the  statistics  to  assess  the  Building  Inspection 
Division’s  actual  productivity. 
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Various  activities  other  than  inspections  may  take  an  inspector’s  time.  For  example,  if  an 
inspector  arrives  at  an  address  and  finds  that  entry  to  the  building  is  impossible,  no 
inspection  occurs.  In  this  case,  the  building  inspector  records  that  visit  on  the  daily  report 
as  “no  entry /no  progress,”  and  the  department  counts  this  visit  as  an  inspection.  However, 
the  inspector  can  also  record  activity  in  this  category  if  he  or  she  performs  an  inspection 
and  finds  that  no  progress  has  been  made  on  the  building. 

For  October  1999,  we  found  that  1,180  (23  percent)  of  the  5,137  reported  building 
inspections  were  actually  activities  in  13  categories  that  may  not  represent  inspections. 
Almost  all  (1,150  or  97  percent)  of  these  1,180  reported  inspections  were  in  six 
categories:  permit  expired  (438),  no  entry /no  progress  (190),  correction  required  (186), 
certificate  of  final  completion  and  occupancy  issued  (149),  reinspection  required  (122), 
and  notice  of  violation  issued  (65). 

Although  we  found  that  activity  other  than  inspections  composed  23  percent  of  the 
reported  number  of  building  inspections  for  one  month,  we  could  not  precisely  determine 
the  extent  to  which  the  reporting  of  activities  that  do  not  involve  actual  inspections 
inflates  the  reported  count  of  inspections  and  inspector  productivity.  Some  activity 
categories  when  used  alone  for  a single  site  visit  at  one  address  may  indicate  that  an 
inspection  has  occurred  and  resulted  in  the  activity  described.  For  example,  an  inspection 
may  have  occurred  and  resulted  in  the  inspector's  recording  “reinspection  required”  as  the 
only  activity  for  a visit  to  an  address.  Other  activity  types  such  as  “no  entry /no  progress” 
may  or  may  not  indicate  that  an  inspection  has  occurred  depending  on  whether  the 
inspector  was  able  to  enter  the  premises  but  found  no  progress  or  was  unable  to  enter  the 
building  to  conduct  the  inspection. 

The  department  has  emphasized  productivity  measures  for  its  staff,  including  an 
expectation  that  all  construction  inspectors  conduct  an  average  of  1 1 inspections  per  day. 
If  the  Building  Inspection  Division’s  productivity  in  fiscal  year  1999-2000  had  been  23 
percent  less  than  reported,  it  would  have  decreased  from  an  average  of  12.8  to  9.9 
inspections  per  inspector  per  day,  causing  the  division  to  fall  below  its  goal  of  1 1 
inspections  per  inspector  per  day.  However,  this  level  of  productivity  is  still  comparable 
to  those  of  other  selected  jurisdictions.  For  example,  inspectors  in  San  Diego  County 
perform  an  average  8.4  inspections  per  day,  and  those  in  Portland,  Oregon,  complete  10 
to  1 2 per  day. 


THE  HOUSING  INSPECTION  SERVICES  UNIT 
PERFORMS  ADEQUATELY  BUT  SHOULD  CREATE 
BETTER  RECORDS  AND  IMPROVE  ITS  GOALS 

The  Housing  Inspection  Services  unit  adequately  handles  code  enforcement  cases,  but  it 
should  improve  its  record  keeping  and  goals.  The  Housing  Inspection  Services  unit  has 
made  positive  organizational  changes  to  improve  its  handling  of  cases  that  require 
enforcement  of  housing,  building,  and  other  codes,  and  it  has  decreased  the  number  of 
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unresolved  cases.  However,  the  Housing  Inspection  Services  unit  does  not  keep  complete, 
accurate  records  of  code  enforcement  cases,  and  this  deficiency  can  hinder  the  effective 
resolution  (abatement)  of  the  cases.  Further,  department  management  would  have  a 
clearer  idea  about  the  Housing  Inspection  Services  unit’s  success  in  resolving  code 
enforcement  cases  if  this  unit  established  a goal  and  a performance  measure  defined  in 
terms  of  a target  level  for  its  caseload.  Currently,  the  unit's  goal  relates  to  the  annual  rate 
at  which  the  unit  wants  to  reduce  its  case  backlog. 

The  Housing  Inspection  Services  Unit 

Could  Improve  Its  Record  Keeping 

From  August  2000  to  January  2001,  the  Housing  Inspection  Services  unit  reduced  its 
number  of  active  cases.  However,  it  does  not  keep  complete,  accurate  records  of  the 
cases,  and  this  failure  impedes  its  ability  to  ensure  that  property  owners  resolve  code 
violations.  In  trying  to  determine  if  the  Housing  Inspection  Services  unit  ensures  that 
cases  are  resolved  (abated)  in  a timely  manner,  we  found  that  the  duration  of  code 
enforcement  cases  ranges  widely  and  that  many  reasons  exist  for  delays  in  resolution, 
some  of  which  are  not  the  Housing  Inspection  Services  unit’s  responsibility.  For 
example,  for  the  properties  in  50  cases  we  reviewed,  one  property  was  in  conservatorship, 
and  abatement  was  delayed  because  a court  order  was  needed  to  obtain  money  to  pay  for 
corrective  work.  Two  other  properties  had  been  reinspected  multiple  times,  but  violations 
continued.  Such  cases  can  remain  unresolved  for  years. 

Despite  the  fact  that  code  enforcement  is  inherently  complex  so  that  some  cases  can  take 
months  or  years  to  resolve,  the  active  case  list  erroneously  included  some  records  of 
abated  cases.  This  error  makes  it  appear  that  the  Housing  Inspection  Services  unit  has 
more  unabated  cases  than  it  actually  does.  We  found  that  21  (42  percent)  of  the  50  cases 
we  reviewed  should  not  have  been  on  the  active  case  list.  Further,  the  chief  housing 
inspector  noted  that  the  inspectors  often  do  not  accurately  record  the  hours  they  spend  on 
each  case — -time  for  which  the  department  can  bill  a violator — and  these  inaccuracies  can 
lead  the  department  to  underbill  a violator  and  present  a misleading  record  of  the  case. 

The  chief  housing  inspector  reported  to  us  that  she  is  implementing  changes  to  improve 
these  practices.  She  acknowledged  that  poor  record  keeping  has  limited  the  Housing 
Inspection  Services  unit’s  ability  to  penalize  violators  and  to  evaluate  its  work. 

The  Housing  Inspection  Services 

Unit  Could  Improve  Its  Goal  Setting 

The  Housing  Inspection  Services  unit  does  not  set  specific  goals  for  some  important 
components  of  its  work,  and  the  absence  of  goals  makes  it  difficult  for  this  unit  to  gauge 
its  overall  progress  in  relation  to  its  workload.  The  Housing  Inspection  Services  unit  has 
as  a goal  to  reduce  its  backlog  of  inherited  code  enforcement  cases  by  25  percent  each 
year,  but  eventually  this  goal  will  be  meaningless.  The  Housing  Inspection  Services  unit 
should  but  does  not  have  a “steady-state”  code  enforcement  caseload  target  toward  which 
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it  is  working.  This  target  would  specify  the  number  of  code  enforcement  cases  that  the 
unit  should  handle  at  any  given  time. 

The  department  considers  a case  abated  when  the  developer  or  owner  has  corrected  all 
violations,  the  property  has  received  a final  inspection,  and  the  owner  has  paid  the  final 
bill  for  fines  and  for  time  spent  by  Housing  Inspection  Services  unit  staff.  According  to 
the  chief  housing  inspector,  if  violations  are  corrected  but  the  final  bill  has  not  been  paid, 
the  department  removes  the  case  from  its  automated  Complaint  Tracking  System  but 
keeps  the  case  on  the  active  case  list.  In  August  2000,  violations  in  90  (9  percent)  of 
1 ,004  open  cases  had  been  corrected  but  the  property  owners  had  not  paid  their  final  bills. 

Although  the  department  uses  the  billing  of  violators  as  an  enforcement  tool,  the 
collection  of  the  fees  is  not  the  goal  of  its  Housing  Inspection  Services  unit.  Instead,  the 
primary  function  and  emphasis  of  this  unit  is  to  see  that  builders  and  owners  correct  their 
properties'  code  violations  so  that  buildings  are  safe  for  the  public.  The  Housing 
Inspection  Services  unit  is  currently  unable  to  recognize  fully  its  accomplishments  in 
overseeing  corrections  because  figures  for  the  number  of  corrected  violations  lie  buried  in 
the  active  case  list  until  property  owners  pay  their  final  bills. 


RECOMMENDATIONS 

To  enhance  its  processes  for  recording  and  reporting  management  information,  the 

Department  of  Building  Inspection  should  take  the  following  actions: 

• Ensure  that  the  Plan  Check  Services  unit  automates,  as  much  as  possible,  the 
calculation  of  performance  statistics  so  that  the  unit  saves  staff  time  and  provides 
reports  that  are  accurate.  To  do  so,  Plan  Check  Services  staff  should  consult  with  staff 
of  the  department's  Management  Information  Services  (MIS)  Division  to  determine 
the  relevant  capabilities  of  the  permit  tracking  system.  Plan  Check  Services  staff  and 
managers  should  inform  the  MIS  Division  staff  about  the  kinds  of  performance 
reports  they  need  each  month  and  quarter,  and  they  should  detail  all  the  requirements 
to  incorporate. 

• Develop  a system  that  checks  the  accuracy  of  data  entry  and  calculated  statistics  to 
ensure  that  statistics  reported  by  the  Plan  Check  Services  unit  are  correct. 

• Make  certain  that  the  Building  Inspection  Division  includes  only  actual  inspections  in 
the  counts  it  uses  to  calculate  inspector  productivity.  To  do  so,  the  division  could 
revise  the  inspectors’  daily  report  form  to  distinguish  between  inspection-related 
activities  and  inspections. 

• See  that  the  Housing  Inspection  Services  unit  continues  to  improve  its  record  keeping, 
particularly  its  methods  for  noting  the  amount  of  time  housing  inspectors  spend  on 
code  enforcement  cases. 
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• Have  the  Housing  Inspection  Services  unit  consider  establishing  a target  caseload  size 
that  it  will  maintain  after  it  eliminates  the  old,  unabated  cases.  This  target  will  help 
measure  the  division’s  success  in  handling  newer  cases  effectively. 

• Direct  the  Housing  Inspection  Services  unit  to  consider  using  as  a performance 
measure  the  number  of,  or  the  rate  at  which,  builders  or  owners  correct  code 
violations  rather  than  counting  as  abated  only  those  cases  for  which  property  owners 
have  paid  their  final  bills.  The  improvement  of  substandard  housing  is  more  important 
to  the  public  and  to  the  City  and  County  of  San  Francisco  than  are  the  fines  or  fees 
that  the  Housing  Inspection  Services  unit  collects. 

• Monitor  the  effects  of  changes  in  code  enforcement  procedures  to  ensure  that  the 
Housing  Inspection  Services  unit  is  processing  abatement  cases  efficiently  and 
effectively  and  that  the  unit's  caseload  does  not  rise  to  previous  levels. 
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CHAPTER  5 

THE  DEPARTMENT’S  CUSTOMERS  AND  EMPLOYEES  EXPRESS 
GENERAL  SATISFACTION  WITH  THE  DEPARTMENT 

CHAPTER  SUMMARY 

We  were  able  to  survey  the  customers  and  employees  of  the  Department  of 
Building  Inspection  (department)  to  learn  their  perceptions  about  the 
department's  performance.  Our  two  surveys  revealed  that  customers  and 
employees  are  generally  satisfied  with  the  department.  However,  responses  to  the  surveys 
also  pointed  out  certain  problems,  deficiencies,  and  areas  of  concern.  Customers  raised 
concerns  about  the  level  or  quality  of  services  provided  by  the  department  either  in  the 
permit  application  process  or  in  the  inspection  process,  while  employees’  concerns  related 
to  fairness  in  hiring  and  promotion,  outside  influences  on  the  department,  and  workplace 
and  employment  issues. 

Department  management  should  be  able  to  address  easily  many  of  the  concerns  expressed 
by  customers  and  employees,  and  the  department  may  correct  or  enhance  its  delivery  of 
services  to  the  public  based  on  the  results  of  these  surveys.  Indeed,  customers  gave  the 
department  favorable  ratings  because  of  its  obvious  focus  on  serving  its  customers  well. 
Nevertheless,  the  department  must  balance  its  emphasis  on  customer  satisfaction  with  its 
regulatory  mission  to  enforce  the  City’s  building  codes.  Conversely,  the  value  of  customer 
opinion  surveys  is  limited  because  even  fair,  courteous  enforcement  of  building 
regulations  may  not  satisfy  some  customers. 


BACKGROUND 

Public  and  private  organizations  often  use  customer  satisfaction  and  employee  surveys  to 
gauge  the  effectiveness  of  the  organizations'  services.  Such  surveys  can  also  provide  an 
organization  with  valuable  information  for  identifying  areas  that  need  attention  and  for 
improving  the  organization's  overall  operations.  Organizations  like  the  department  that 
have  a strong  focus  on  customer  service  should  establish  a continuous  or  periodic  survey 
process  to  obtain  comments  and  suggestions  from  the  customers  it  serves.  In  this  audit 
report,  we  have  not  attempted  to  describe  in  detail  the  results  or  implications  of  all  the 
responses  to  the  surveys’  questions.  Instead,  we  present  a summary  of  each  survey’s  most 
significant  results.  Under  separate  cover,  we  have  given  the  department  the  complete 
results  of  both  surveys. 
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Survey  of  Customers 

We  contracted  with  the  Public  Research  Institute  (institute)  of  San  Francisco  State 
University  to  assist  us  in  developing  and  administering  a survey  of  a sample  of  the 
department’s  customers.  The  institute  mailed  questionnaires  to  2,502  customers  who  had 
applied  for  permits  from  June  2000  through  December  2000.  Of  the  surveys  mailed, 

2,303  were  deliverable.  From  this  pool,  we  received  576  questionnaires  by  the  due  date, 
for  a response  rate  of  25  percent. 

The  survey  of  department  customers  asked  about  the  types  of  permits  for  which 
customers  applied,  the  application  processes,  and  customers'  ratings  of  the  service  they 
received.  The  application  processes  covered  in  the  survey  included  that  of  the 
department’s  Central  Permit  Bureau,  which  handles  most  applications;  the  process  used 
by  the  One-Stop  Permit  Coordination  unit,  which  has  employees  from  two  or  more 
departments  simultaneously  review  applications  that  need  approvals;  and  the  process  at 
the  Express  Window,  which  deals  with  simple  applications  that  do  not  require  plans.  We 
asked  about  the  promptness  with  which  department  staff  notified  customers  of  changes 
needed  in  their  plans  and  whether  staff  was  helpful  in  minimizing  delays.  We  inquired 
whether  customers  used  outside  agents  (expediters)  to  help  manage  the  processing  of 
their  plans  or  permit  applications.  In  addition,  we  asked  about  the  timeliness  and  ease 
with  which  customers  were  able  to  schedule  inspections  and  about  the  professionalism, 
fairness,  and  competence  displayed  by  the  department’s  inspectors.  The  survey  also  asked 
customers  to  describe  the  department’s  services  in  general  and  to  provide  any  additional 
comments  or  suggestions  for  improvement.  Finally,  respondents  were  to  describe  their 
business  at  the  department  and  the  frequency  with  which  they  apply  for  permits  with  the 
department.  Appendix  A presents  the  customer  survey  questionnaire,  and  Appendix  C 
presents  the  executive  summary  from  the  final  report  on  survey  results. 

Survey  of  Employees 

To  measure  the  “climate”  of  the  department,  the  employee  survey  asked  employees  for 
their  opinions  about  the  department  in  general,  about  the  productivity  and  quality  of  work 
of  their  work  units,  and  about  management  of  the  department.  Our  questionnaire  also 
asked  about  the  adequacy  of  training  opportunities  and  the  extent  of  computer  use  and 
other  technology.  Additionally,  we  asked  about  employees'  attitudes  toward  changes 
occurring  in  the  department,  about  their  opinions  of  morale  among  employees,  and  about 
critical  areas  they  think  the  department  should  address.  The  survey  also  asked  many 
open-ended  questions,  including  those  addressing  what  employees  like  best  about 
working  for  the  department,  what  the  department  could  do  to  improve  services  to 
customers,  and  what  needs  to  be  changed  or  improved.  Finally,  the  survey  included 
questions  specifically  designed  for  employees  who  worked  in  Permit  Services  and 
Inspection  Services,  the  two  main  programs  that  provide  services  directly  to  customers. 

The  confidential  employee  surveys  were  distributed  to  the  department’s  284  employees, 
and  137  completed  questionnaires  were  returned  for  a response  rate  of  48  percent. 
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Appendix  B presents  the  employee  survey  questionnaire,  and  Appendix  D presents  a 
more  detailed  summary  of  the  survey  results. 


CUSTOMERS  ARE  GENERALLY  SATISFIED  BUT 
FEEL  SOME  AREAS  NEED  IMPROVEMENT 

The  customer  survey  indicated  that  the  department’s  customers  are  generally  satisfied 
with  the  services  they  received,  but  some  responses  indicated  there  may  be  deficiencies 
and  problems  that  present  the  department  with  opportunities  for  improvement. 

When  asked  to  rate  the  department’s  service  overall,  65  percent  of  customers  indicated 
that  they  had  received  good  or  excellent  service  from  the  department  in  the  past  year,  26 
percent  rated  service  as  fair,  and  only  9 percent  characterized  the  service  as  poor  or  very 
poor.  Although  it  is  not  reasonable  to  expect  1 00  percent  customer  satisfaction,  the 
department  should  consider  gathering  information  on  those  customer  experiences  rated 
fair  to  poor  to  determine  the  areas  that  need  improvement. 

Customers  Rated  the  Permit 

Application  and  the  Plan-Check 

Process  Favorably 

The  majority  (65  percent)  of  customers  rated  permit  application  services  as  good  or 
excellent,  and  most  (86  percent)  said  the  department’s  employees  were  helpful  and 
courteous  during  the  application  process.  Of  the  60  percent  of  customers  who  indicated 
they  had  problems  during  the  permit  application  process,  75  percent  said  they  were  able 
to  resolve  the  problems  satisfactorily  with  department  staff.  Customers  also  reported  that 
the  department’s  plan-check  process  is  responsive:  More  than  three-fourths  of  all 
customers  felt  that  they  had  been  notified  promptly  when  corrections  or  changes  were 
required. 

Although  these  results  reflect  positively  on  the  department,  about  half  (49  percent)  of  the 
customers  indicated  that  they  experienced  delays  during  the  plan-check  or  application 
review  process,  and  38  percent  of  these  customers  indicated  that  the  department's  staff 
had  not  been  helpful  in  minimizing  delays.  Although  delays  in  processing  applications 
and  checking  plans  may  occur  for  various  acceptable  reasons,  the  department  should  look 
more  closely  at  the  application  and  plan-check  processes  and  procedures  to  determine 
how  the  department  can  minimize  delays  and  improve  customer  service  when  delays 
occur. 

We  also  designed  the  survey  to  determine  the  extent  to  which  the  department's  customers 
hire  expediters  to  speed  permit  or  project  approval.  If  the  survey  showed  that  many 
permit  applicants  use  expediters,  this  customer  preference  could  indicate  that  the 
department’s  processes  are  not  sufficiently  understandable  to  the  public.  Survey 
responses  showed  that  only  32  (6  percent)  of  516  respondents  used  expediters,  while  484 
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(94  percent)  indicated  that  they  did  not.  Respondents  who  used  expediters  stated  they  did 
so  because  expediters  were  able  to  obtain  permits  more  quickly  than  the  applicants  could, 
expediters  made  the  process  convenient,  and  they  knew  the  process.  Also,  some 
respondents  said  that  they  used  expediters  because  the  department’s  staff  was  too  difficult 
to  deal  with  or  because  the  department  required  too  much  paperwork. 

Customers  Are  Very  Satisfied  With 

One-Stop  Permit  Processing  and 

Will  Continue  to  Use  It 

The  21  percent  of  customers  who  indicated  that  they  used  the  One-Stop  Permit 
Coordination  unit  (One-Stop)  rated  their  experience  as  highly  positive,  and  customers 
believe  that  One-Stop  is  providing  service  that  is  faster  than  the  service  available  through 
normal  procedures  at  the  department.  Of  the  576  customers  responding,  91  (16  percent) 
supplied  information  about  their  use  of  One-Stop.  Nearly  all  customers  (98  percent)  who 
chose  to  use  One-Stop  did  so  to  receive  faster  service,  while  less  than  half  (46  percent) 
indicated  that  they  did  so  because  the  One-Stop  procedures  are  easier  to  use  than  are 
those  in  the  department's  other  units.  Of  those  who  used  One-Stop,  the  vast  majority  (95 
percent)  indicated  they  would  do  so  again  for  future  projects.  Only  a small  minority  (5 
customers)  indicated  that  they  would  not  use  One-Stop  again,  saying  that  staff  had  misled 
them  about  appropriate  procedures,  they  had  received  incorrect  information,  or  they  had 
tried  to  use  One-Stop  several  times  but  had  found  no  one  working  at  the  One-Stop 
counter. 

Not  All  Customers  Describe 

Inspection  Services  Favorably 

Although  a majority  of  customers  seem  satisfied  with  inspection  services,  the  department 
should  examine  the  reasons  why  some  customers,  particularly  those  seeking  residential 
inspections,  appear  less  pleased  with  their  experience  in  making  appointments  and 
contacting  inspectors.  The  majority  (65  percent)  of  customers  rated  as  “somewhat  easy” 
the  scheduling  of  inspections  and  the  customers'  contacting  or  meeting  with  inspectors. 
Most  of  these  customers  said  that  they  had  received  timely  inspection  appointments  either 
within  48  hours  or  on  a date  they  had  requested;  these  time  limits  are  part  of  the 
department’s  goals  for  all  inspections.  However,  15  percent  of  customers  rated  acquiring 
these  services  as  "somewhat"  or  "very"  difficult.  Survey  results  indicated  that  customers 
seeking  residential  inspections  found  making  appointments  more  difficult  than  did 
customers  seeking  other  kinds  of  inspections. 

Most  customers  generally  agreed  that  the  inspectors  they  worked  with  were  professional 
(78  percent),  fair  (70  percent),  and  competent  (73  percent).  However,  electrical  permit 
customers  rated  inspectors  somewhat  lower  on  all  three  attributes  than  did  nonelectrical 
permit  customers.  Because  the  survey  did  not  allow  us  to  determine  the  cause  for  these 
lower  ratings,  the  department’s  Inspection  Services  Program  should  determine  whether 
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factors  under  the  department’s  control  explain  this  perception  and  whether  the  department 
can  change  this  view  of  electrical  inspectors. 


Customer  Survey  Results  Show  Areas 
That  the  Department  Needs  to  Improve 


Of  537  respondents,  73  percent  indicated  that  they  experienced  at  least  one  type  of 
problem,  1 0 percent  experienced  four  or  more  problems,  and  26  percent  experienced  no 
problems  with  the  department’s  service  in  the  past  year.  Exhibit  6 shows  the  percentage 
of  responses  to  this  survey  question  by  problem  type. 

Exhibit  6 

Service  Problems  That  Customers  Experienced  in  the  Past  Year* 


Problem  Type 

Percentage  of  537 
Customers  Responding** 

Total 

Respondents 

Inspectors  are  inconsistent*** 

35.0 

188 

Permit  approval  takes  too  long 

29.4 

158 

Permit  fees  too  high 

19.2 

103 

Inspection  scheduling  is  too  difficult 

18.6 

100 

Plan-check  process  inefficient 

18.4 

99 

Permit  application  process  confusing 

15.5 

83 

Other  problems0 

20.3 

109 

* The  year  preceding  the  customer’s  response,  or  sometime  during  calendar  year  2000. 

**  The  same  customer  may  have  reported  more  than  one  problem. 

***  Customer  indicated  that  different  inspectors  reached  different  conclusions  about  the  same 
condition. 

° Those  cited  in  written  comments  from  customers. 

The  survey  also  asked  customers  to  give  additional  comments  about  services  and  to 
suggest  ways  the  department  can  improve.  Written  responses  included  both 
complimentary  remarks  and  criticisms  about  specific  services.  Some  critical  comments 
related  to  long  lines  at  permit  counters,  difficulties  with  payment  processing,  inconsistent 
code  interpretation  from  the  department’s  staff,  slow  plan-check  processing,  difficult 
scheduling  processes  for  inspectors  other  than  building  inspectors,  lack  of  online  permit 
processing,  and  insufficient  parking  for  customers.  A small  number  of  comments  about  a 
particular  problem  may  represent  the  experiences  or  concerns  of  many  other  customers 
who  have  chosen  not  to  express  them.  These  comments  can  also  help  department 
management  identify  opportunities  for  improving  its  customer  service. 
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The  Department's  Emphasis  on  Customer 
Service  May  Conflict  With  Its  Mission 

While  we  applaud  the  department’s  efforts  to  improve  customer  service,  we  acknowledge 
that  customer  satisfaction  is  not  the  sole  measure  of  the  department’s  success.  According 
to  the  department’s  management  and  its  annual  report,  the  department  places  a strong 
emphasis  on  providing  good  customer  service — and  quick  responses — to  the  contractors, 
builders,  architects,  owners,  and  others  seeking  permits  and  inspections  of  work 
performed  on  their  projects.  For  example,  goals  for  1998-1999  included  increasing 
customer  service  training,  increasing  the  number  of  over-the-counter  approvals  for 
commercial  permit  applications,  hiring  additional  staff  to  meet  demand  for  residential 
plan  checks,  and  performing  more  than  92  percent  of  inspection  requests  within  48  hours 
or  as  requested  by  customers  through  the  Building  Inspection  Division.  However,  the 
department's  mission  statement  says  that  the  department  serves  the  City  and  County  of 
San  Francisco  and  the  public  by  ensuring  public  safety  through  the  enforcement  of 
building  codes  and  regulations.  The  department  must  balance  its  emphasis  on  customer 
satisfaction  with  its  charge  to  safeguard  life  and  property. 


EMPLOYEES  ARE  GENERALLY  SATISFIED 
WITH  WORKING  FOR  THE  DEPARTMENT 
BUT  HAVE  CONCERNS  ABOUT  FAIRNESS 

The  levels  of  satisfaction  expressed  by  employees  and  their  assessment  of  a department’s 
level  of  functioning  are  valid  indicators  of  a department’s  effectiveness.  The  responses  to 
our  survey  of  employees  at  the  Department  of  Building  Inspection  indicate  that  the 
department’s  employees  generally  feel  positive  about  their  jobs,  that  the  quality  of  their 
work  is  high,  and  that  their  productivity  has  improved  in  recent  years.  Employees  also 
feel  the  department  contributes  to  the  City’s  quality  of  life  and  that  the  department  has 
made  progress  toward  improving  customer  service.  Further,  employees  generally 
understand  the  department’s  goals  and  objectives,  and  they  believe  that  the  department  is 
fulfilling  its  mission.  In  addition,  most  employees  think  that  the  department  is  well 
managed,  that  communication  between  management  and  staff  is  good,  and  that  morale  in 
their  respective  work  units  is  high. 

However,  as  Chapter  1 discusses,  some  employees  feel  that  the  department  has  allowed 
some  customers,  including  expediters  hired  as  agents  by  customers,  to  affect  adversely 
the  ability  of  permit  processing  and  building  inspection  staff  members  to  perform  their 
jobs  in  a professional  manner.  In  written  comments,  some  employees  expressed  concern 
about  a lack  of  fairness  in  employee  hiring  and  promotions,  and  some  indicated  that 
relations  and  communication  among  management  and  staff  need  improvement.  Other 
employee  responses  focused  on  problems  related  to  workload,  computer  system 
reliability,  workspace,  and  training  issues.  On  the  other  hand,  the  majority  of  responding 
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employees  did  not  express  these  concerns.  Appendix  D presents  a summary  of 
employees’  responses  to  the  survey. 


RECOMMENDATIONS 

Surveys  provide  only  some  of  the  information  needed  to  assess  organizational 
effectiveness.  Nevertheless,  to  obtain  reliable  information  from  its  customers  and 
employees  that  would  help  to  gauge  its  success  in  delivering  services  and  assist  its 
continuing  efforts  to  achieve  its  mission,  the  Department  of  Building  Inspection  should 
do  the  following: 

• Use  the  results  of  our  customer  survey  and  employee  survey  as  a guide  to  improve 
business  processes,  management  and  staff  relations,  and  customer  service.  In 
particular,  examine  why  customers  seeking  residential  inspections  and  those  receiving 
electrical  inspections  are  less  satisfied  than  others  are. 

• Periodically  conduct,  or  contract  for,  formal  surveys  of  its  customers.  A survey 
consultant  could  develop  a sound  survey  instrument  that  the  department  could 
administer  regularly,  or  the  department  could  contract  with  a professional  survey 
organization  to  administer  and  analyze  a survey. 

• Consider  conducting  periodic,  confidential  employee  surveys. 


We  conducted  this  audit  according  to  generally  accepted  government  auditing  standards. 
We  limited  our  review  to  those  areas  specified  in  the  audit  scope  section  of  this  report. 


Staff:  Mark  Tipton,  Audit  Manager 

Millicent  Bogert 
Carrie  Fassett 
John  Haskell 
Richard  Hendry 
Kai  Mander 
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Department  of  Building  Inspection  Customer  Survey 


nstructions:  The  person  who  handled  the  most  recently  completed  project  with  the  Department  of  Building 
nspection  (DBI)  should  fill  out  this  survey.  Please  check  the  appropriate  box  or  boxes  like  this:  [>^. 


a. 

□ General  question 

b. 

□ Code  question 

c. 

□ Permit  application 

1.  What  was  the  purpose  of  your  or  your  firm’s  most 

d. 

□ Records  management 

recently  completed  business  with  DBI? 

e. 

□ Inspection 

(Check  all  that  apply) 

f. 

□ Plan  check 

g- 

□ Request  a meeting 

h. 

□ Other 

Section  1 : Permit  Application  Process 


Please  answer  Sections  1-3  in  reference  to  your  MOST  RECENTLY  completed  project  with  DBI. 


a. 

□ Yes 

2. 

If  you  went  to  DBI  to  apply  for  a permit,  were 

b. 

□ No 

staff  helpful  and  courteous? 

c. 

□ I was  not  the  person  who  applied  for  the  permit 

d. 

□ I don’t  remember 

a. 

□ Commercial 

b. 

□ Residential 

3. 

What  type  of  permit  were  you  seeking? 

c. 

d. 

□ Building 

□ Major  project 

( Check  all  that  apply) 

e. 

□ Plumbing  or  mechanical 

f. 

□ Electrical 

g- 

□ Other 

4. 

Where  did  you  submit  your  permit  application? 

f 

□ One-Stop  Counter  (GO  TO  SECTION  la) 

□ Express  Window 

SKIP  SECTION  la 

c 

□ Central  Permit  Bureau  (front  or  main  counter) 

□ I didn’t  submit  the  application/plans 

e. 

□ I don’t  remember  which  counter  I used 
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op 1 

top  ^ 


How  did  you  decide  to  use  One-Stop  permit  processing? 

a.  □ I chose  to  go  directly  to  One-Stop 

b.  □ DBI  staff  referred  me  to  One-Stop 
6.  If  you  chose  to  use  One-Stop,  please  indicate  why. 

(Check  all  that  apply) 

a.  □ Easier  to  use 

b.  □ Faster  service 

c.  □ 

Other 

^7.  Would  you  use  One-Stop  again  for  future  projects? 

a.  □ Yes 

b.  □ No 
> Why 


a.  □ Yes 

8.  If  you  provided  your  own  estimated  cost  for  the 
work,  did  DBI  increase  it? 

b.  □ No 

c.  □ I did  not  provide  an  estimate 

d.  □ I don’t  know 

9.  Overall,  how  would  you  rate  the  service  DBI  provided  during  the  permit  application  process? 

(Circle  the  appropriate  number) 

Good  Fair  Poor 

2 3 4 

Very  poor 
5 

10.  If  you  had  problems  with  the  processing  of  your 
permit  application  or  plans,  were  you  able  to 
resolve  them  satisfactorily  with  DBI  staff? 

a.  □ Yes 

b.  □ No 

c.  □ I did  not  have  any  problems 

d.  □ There  were  problems  but  I did  not  handle  them 

Section  2:  Plan  Check  and  Permit  Processing 

11.  Were  you  promptly  notified  of  any  corrections  or 
changes  that  were  necessary  to  your  plans  or 
application? 

a.  □ Yes 

b.  □ No 

c.  □ Not  applicable 

12.  If  there  were  delays  in  reviewing  your  plans  or 
application,  were  DBI  staff  helpful  in  minimizing  the 
delay? 

a.  □ Yes,  they  were  helpful  in  minimizing  the  delay 

b.  □ No,  they  were  not  helpful 

c.  □ There  were  no  delays 

d.  □ There  were  delays  but  I did  not  handle  them 

13.  Did  you  use  an  outside  expediter  to  apply  for  your 
permit  or  manage  the  processing  of  the  permit 

a.  □ Yes 

Why  did  you/your  firm  use  an  expediter? 

application  or  plans? 

b.  □ No 

- 

14.  Was  your  permit  issued  within  7 days  of  your 
application? 

a.  □ Yes 

b.  □ No 
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Section  3:  Inspection  Scheduling  and  Inspection  Services 


15.  Were  you  able  to  schedule  all  inspections  within  48  hours  of  your 
request  OR  on  a date  that  you  requested? 


a.  □ Yes 

b.  □ No 


16.  How  easy  was  it  for  you  to... 
(Circle  the  appropriate  number) 

a.  make  the  inspection  appointment? 

b.  contact  or  meet  with  an  inspector? 


Very  easy 


Somewhat 

easy 

2 

2 


Somewhat 

difficult 

4 

4 


Very  difficult 


17.  Please  rate  the  extent  to  which  you  feel  the  inspector(s)  with  whom  you  worked  were... 

(Circle  the  appropriate  number) 

Strongly  agree  Somewhat  agree  Neutral  Somewhat  disagree 

a.  Professional  12  3 4 

b.  Fair  12  3 4 

c.  Competent  1 2 3 4 


Strongly  disagree 
5 
5 
5 


Section  4:  DBI  Service  Overall 

Please  answer  Section  4 in  reference  to  your  OVERALL  EXPERIENCE  with  DBI  in  the  past  year. 


18.  Overall,  how  would  you  rate  the  service  provided  by  DBI  in  the  past  year? 


(Circle  the  appropriate  number) 


Excellent 


Good 

2 


Fair 

3 


Poor 

4 


Very  poor 
5 


19.  Please  identify  any  problems  you  have  experienced 
with  DBFs  service  in  the  past  year: 

(Check  all  that  apply) 


a.  □ Permit  application  process  is  confusing 

b.  □ Permit  fees  are  too  high 

c.  □ Plan  check  process  is  inefficient 

d.  □ Permit  approval  takes  too  long 

e.  □ Inspection  scheduling  is  too  difficult 

f.  □ Inspectors  are  inconsistent  (for  example,  if  inspectors 
reach  different  conclusions  about  the  same  condition) 

g.  □ I have  NOT  experienced  any  of  these  problems 

h.  □ Other  problem  (describe  in  question  20  below) 


20.  Please  provide  any  additional  comments  about  DBFs  service  or  suggestions  for  improvement: 


Section  5:  About  You 


a. 

□ Contractor 

b. 

□ Developer 

c. 

□ Owner 

21.  I am  a(n): 

d. 

□ Agent  or  representative 

e. 

□ Professional  expediter 

f. 

□ Other 

a. 

□ Only  once 

b. 

□ 2 to  3 times  per  year 

22.  I (my  firm)  apply  for  permits: 

c. 

□ 4 to  9 times  per  year 

d. 

□ 1 0 times  or  more  per  year 
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Department  of  Building  Inspection 


For  each  of  the  questions  below,  please  check  the  box  next  to  the  correct  response,  or  answer  as 
indicated.  Answers  from  these  questions  will  be  kept  strictly  confidential. 


1 . My  job  classification  is:  (check  one) 

a.  □ Information  Systems  (1002,  1023,  1043,  1044,  1051,  1053,  1071) 

b.  □ Administration  (1372,  1374,  1375,  1378,5180,  5181) 

c.  □Administrative  Support  (1203,  1222,  1241,  1244,  1270,  1367,  1404,  1408,  1410,  1424, 

1426,  1444,  1446,  1452,  1632,  1654,  1823,  1840,  1842,  4321) 

d.  □ Civil  and  Mechanical  Engineers  (5204,  5206,  5208,  5210,  5214,  5252,  5256) 

e.  □ Plumbing  Inspectors  (6242,  6246) 

f.  □ Electrical  Inspectors  (6248,  6249,  6250) 

g.  □ Housing  Inspectors  (6270,  6272,  6274) 

h.  □ Building  Inspectors  (6331,  6333,  6334) 

i.  □ Other  Professional  and  Technical  Support  (1752,  5217,  6138,  other) 

2.  I work  in:  (check  one) 
a □ Permit  Services 

b.  □ Inspection  Services 

c.  □ Administration 


3.  I have  worked  at  the  Department  of  Building  Inspection,  including  DPW,  for:  (check  one) 

a.  □ Less  than  1 year  d.  □ 5 to  under  10  years 

b.  □ 1 to  under  2 years  e.  □ 10  years  or  over 

c.  □ 2 to  under  5 years 

4.  Other  than  English,  I can  speak,  or  read  and  write  the  following  languages: 


□ Chinese  (Cantonese) 

□ Chinese  (Mandarin) 

□ Korean 

□ Russian 


□ Spanish 

□ Tagalog 

□ Vietnamese 

□ Other  (specify: ) 
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Building  Inspection  Department 
Overall 

Agriy  te 

Simnsly 
Disagree  Disagree 

Not  Sure 

5.  The  work  of  the  Building  Inspection  Department 
contributes  to  the  improvement  of  the  City’s 
quality  of  life. 

1 2 

3 4 

X 

6.  The  department  has  made  good  progress  toward 
improving  customer  service. 

1 2 

3 4 

X 

7.  The  goals  and  objectives  of  the  department  are 
clearly  defined. 

1 2 

3 4 

X 

8.  The  department  has  a strategy  in  place  for  future 
growth  and  improvement. 

1 2 

3 4 

X 

9.  The  department’s  strategy  for  future  growth  and 
improvement  has  been  communicated  to  all  staff. 

10.  The  department  is  fulfilling  its  mission  “to 
oversee  the  effective,  efficient,  fair  and  safe 

1 2 

3 4 

X 

enforcement  of  the  City’s  building,  housing, 
plumbing,  electrical,  and  mechanical  codes,  as 
well  as  disability  access  regulations.” 

1 2 

3 4 

X 

IVIy  Job 

Strongly 

Agree  Agree 

Strongly 
Disagree  Disagree 

Not  Sure 

1 1 . Overall,  I am  satisfied  with  my  job. 

I 2 

3 4 

X 

12.  In  the  past  two  years,  the  productivity  of  my  work 
unit  has  improved. 

1 2 

3 4 

X 

13.  The  overall  quality  of  work  being  done  in  my 
work  unit  is  high. 

1 2 

3 4 

X 

14.  I have  a clear  understanding  of  what  constitutes 
acceptable  performance  in  my  job. 

1 2 

3 4 

X 

15.  People  in  my  work  unit  can  get  by  without 
meeting  the  minimum  performance  standards. 

1 2 

3 4 

X 

16.  Building  Inspection’s  policies  and  procedures 
manuals  help  me  perform  my  job  better. 

1 2 

3 4 

X 

17.  There  is  enough  staff  in  my  work  unit  to 

adequately  perform  work  we  are  required  to  do. 

1 2 

3 4 

X 

18.  With  the  workload  I have,  I am  able  to  perform 
my  job  duties  effectively. 

1 2 

3 4 

X 
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Management 

Strongly 

Agree 

Agree 

Disagree 

Strongly 

Disagree 

Not  Sure 

19.  All  in  all,  the  department  is  well  managed. 

1 

2 

3 

4 

X 

20.  My  division’s  management  has  high  standards  and 
expects  that  employees  produce  high  quality  work. 

1 

2 

3 

4 

X 

21.  My  work  unit  is  well  managed. 

1 

2 

3 

4 

X 

22.  I know  exactly  what  my  supervisor  expects  of  me. 

1 

2 

3 

4 

X 

23.  When  I have  a question  about  my  job,  I can  go  to 
written  policies  and  procedures  or  to  my 
supervisor  and  receive  reliable,  up-to-date 
information. 

I 

2 

3 

4 

X 

24.  Management  does  a good  job  of  seeking  out  the 
opinions  and  suggestions  of  its  employees. 

1 

2 

3 

4 

X 

25.  The  quality  of  communication  between 
management  and  staff  is  good. 

1 

2 

3 

4 

X 

26.  Policies  and  procedures  related  to  my  job  duties 
are  clearly  defined  and  consistently  applied. 

1 

2 

3 

4 

X 

Training 

Strongly 

Agree 

Agree 

Disagree 

Strongly 

Disagree 

Not  Sure 

27.  I am  satisfied  with  the  opportunities  for  training 
and  development  that  are  provided  to  me. 

1 

2 

3 

4 

X 

28.  The  training  I have  received  has  been  relevant;  that 
is,  it  has  increased  my  professional  knowledge  and 
improved  my  level  of  competence  on  the  job. 

' 

2 

3 

4 

X 

29.  Answer  only  if  applicable  to  your  job:  I 

have  received  sufficient  training  on  the  Permit 
Tracking  System  to  use  it  effectively. 

' 

2 

3 

4 

X 

30  Answer  only  if  applicable  to  your  job:  I 

1 

2 

3 

4 

X 

have  received  sufficient  training  on  the  Point  of 
Sale  (POS)  system  to  use  it  effectively. 

31.  Answer  only  if  applicable  to  your  job:  do 

you  hold  a building,  plumbing,  electrical, 
mechanical  or  other  certification  from  ICBO  or 
other  professional  organization? 

a.  OYes  b.  □ No 

32.  If  you  answered  “No”  to  item  31,  are  you  planning 
to  obtain  professional  certification? 

a.  CJYes  b.  □ No 
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Computers  and  Other  Technology 


33.  Do  you  use  a computer  in  the  performance  of  your  job  duties? 
a □ Yes  +Ifyes>  8° to  the  next  question. 

b □ No  no,  go  to  question  38. 

34.  Check  the  response  that  best  describes  how  often  you  use  the  computer  you  have  at  your  disposal. 

a.  □ Frequently  each  day  c.  □ A few  times  a week  e.  □ Rarely 

b.  □ Occasionally  each  day  d.  □ Several  times  a month  f.  HI  Never 

35.  If  you  checked  a box  other  than  frequently  (box  a.)  in  question  34,  indicate  why  you  don’t  use  a computer 
more  often  (check  all  that  apply): 

a.  □ Using  a computer  is  not  necessary  for  performing  some  of  my  job  duties. 

b.  □ I would  use  my  computer  more  often  if  I had  more  training. 

c.  □ The  computer  equipment  I have  is  not  adequate  to  perform  my  job  duties. 

d.  □ Rather  than  use  the  computer,  I prefer  to  use  pen/pencil  and  paper. 

e.  □ Other  (please  describe):  


Please  circle  the  response  that  best  represents  how 
you  feel. 


36.  I have  received  the  computer  training  I need  in  1 2 3 4 X 

order  to  use  the  computer  effectively  in  my  work. 

37.  There  is  adequate  technical  support  available  for  1 2 3 4 X 

computer  users  when  they  have  questions  or 

problems. 

38.  Greater  use  of  computers  and/or  other  technology  1 2 3 4 X 

would  help  me  be  more  efficient  in  performing 

my  job  duties. 


39.  Greater  use  of  computers  and/or  other  technology  1 2 3 4 X 

would  improve  the  Building  Inspection 
Department’s  productivity. 


40.  My  supervisor  encourages  our  work  unit’s  use  of 
computers  and/or  other  technologies. 


2 3 4 X 
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Strongly  Strongly 

Agree  Agree  Disagree  Disagree  Not  Sure 


Change 


41 . In  my  work  unit,  most  people  are  receptive  to,  and 
ready  for,  change. 

42.  The  changes  currently  being  made  by 
management  are  probably  needed  to  make  the 
department  function  more  effectively. 

43.  Department  management  is  open  to  suggestions 
for  change  from  staff. 

44.  The  department  needs  to  implement  changes  more 
quickly  in  order  to  be  more  effective. 

45.  Attempts  to  implement  changes  in  the  department 
are  creating  more  problems  than  they  solve. 


2 3 4 X 

2 3 4 X 

2 3 4 X 

2 3 4 X 


2 3 4 X 


Organizational  Pride  and 
Performance 


Strongly  Strongly 

Agree  Agree  Disagree  Disagree  Not  Sure 


46.  In  my  work  unit,  employee  attitudes  support 
above  average  performance. 

47.  Most  of  the  people  I work  with  take  pride  in  the 
quality  of  their  work. 

48.  I am  proud  to  tell  people  I work  for  the 
Department  of  Building  Inspection. 

49.  Morale  in  the  department  is  generally  good. 


1 2 3 4 X 

1 2 3 4 X 


1 2 3 4 X 

1 2 3 4 X 


50.  Morale  in  my  work  unit  is  generally  good. 


2 3 4 X 


51.  If  you  indicated  in  question  49  or  50  that  morale  in  the  department  or  your  work  unit  was  not  good,  what 
do  you  think  can  be  done  to  improve  it  (select  all  that  apply): 

a.  □ Incentive  programs  (recognition  programs,  social  gatherings,  etc.) 

b.  □ More  consistent  application  of  disciplinary  procedures  and  promotional  opportunities 

c.  □ Additional  training  (please  specify): 

d.  □ Other  (please  explain): 


52.  Approximately  when  did  you  receive  your  last  performance  appraisal? 


a.  □ Within  the  last  year 

b.  □ 1 to  2 years  ago 

c.  □ 2 to  3 years  ago 


d.  □ 3 to  5 years  ago 

e.  □ Over  5 years  ago 

f.  □ I have  never  received  an  appraisal  or  review  while  working  here. 
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53.  Of  the  categories  listed  below,  please  identify  the  THREE  (3)  areas  you  feel  are  most  critical  for  the 
department  to  address  in  order  to  improve  its  performance.  Mark  your  3 choices  with  an  “X”  as  being 
the  most  important. 

a.  Workload 

b.  Management-staff  relations 

c.  Compensation  (pay/benefits) 

d.  Physical  working  conditions 

e.  Employee  morale 

f.  Department  policies  and  procedures 

g.  Employee  performance  appraisal/review  system 

h.  General  job  training 

i.  Computer  training 


j.  Management  direction  or  guidance 

k.  Computerized  systems  or  other  technology 

l.  Employee  safety 

m.  Professional  competence  of  staff 

n.  Professional  competence  of  management 

o.  Customer  Services 

p.  Other  (specify) 


Additional  Questions 


54.  What  is  the  ONE  thing  you  like  best  about  working  for  the  Department  of  Building  Inspection? 


55.  What  ONE  thing  could  be  done  to  improve  services  to  Department  of  Building  Inspection 
customers? 


56.  If  there  was  ONE  thing  you  could  change,  what  would  it  be  and  how  would  you  improve  it? 
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If  you  want  to  provide  more  detailed  information  about  any  question  in  this  survey, 
please  write  it  here  with  the  question  number  next  to  it. 


ATTENTION! 

Permit  Services  employees: 

Please  continue  to  page  8 and  answer  questions  57  through  73. 
Inspection  Services  employees: 

Please  continue  to  page  10  and  answer  questions  74  through  91 . 
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**********Questions  57-73  are  for  Permit  Services  Employees  Only********** 


Permit  Services 


PLAN  CHECKERS  - PLEASE  ANSWER  QUESTIONS  57  through  68: 

57.  Which  area  in  Plan  Check  Services  do  you  work  in? 

a.  □ Major/UMB  Plan  Check  c.  □ Residential  Plan  Check 

b.  □ Commercial  Plan  Check  d.  □ Mechanical  Plan  Check 

58.  How  many  plans  do  you  check  on  average  each  day? 

59.  How  many  plans  do  you  believe  is  reasonable  to  check  in  one  day? 

60.  Check  the  box  that  best  describes  your  workload: 

a.  □ Manageable  b.  □ Barely  Manageable  c.  □ Unmanageable 

61.  Do  you  feel  you  spend  too  much  time  answering  questions  from  parties  other  than  customers.  For 
example,  do  you  handle  inquiries  from  the  public,  the  media,  or  neighborhood  organizations,  activities 
that  are  not  directly  related  to  the  performance  of  your  job  duties? 

a.  □ Yes  b.  DNo 

62.  If  you  answered  “Yes”  to  question  61,  estimate  the  percent  of  time  you  spend  performing  your  plan 
checking  and  other  job  duties  versus  handling  non-job  related  questions  and  complaints,  and/or 
neighborhood  concerns. 

% Performing  job  duties  % Non-job  related  customer  and  media  inquiries 

and/or  individual  and  neighborhood  complaints/concems 

63.  If  you  answered  “Yes”  to  question  61,  do  you  believe  that  questions  and  complaints  that  are  not  job- 

related  should  be  handled  by  staff  in  Customer  Services  or  another  division? 

a.  OYes  b.  ONo  c.  □ Not  Sure 

64.  Have  you  witnessed  customers  receiving  improper  preferential  treatment? 

a.  OYes  b.  ONo  c.  □ Not  Sure 

65.  Has  a supervisor  ever  asked  you  to  give  a customer  improper  preferential  treatment? 

a.  CJYes  b.  ONo  c.  □ Not  Sure 

66.  How  often  do  you  deal  with  expediters  hired  by  customers? 

a.  □ Every  Day  b.  □ At  least  once  a week  c.  □ At  least  once  a month  d.  □ Rarely  e.  □ Never 
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PLAN  CHECKERS:  Answer  Questions  67  and  68  only  if  you  have  dealt  with  expediters  hired  by 
customers . 

67.  Has  an  expediter  hired  by  a customer  ever  asked  you  for  improper  preferential  treatment? 

a.  GYes  b.  GNo  c.  □ Not  sure 

68.  If  you  answered  Yes  to  question  67,  have  you  ever  witnessed  an  expediter  receiving  improper  preferential 
treatment? 

a.  GYes  b.  GNo  c.  G Not  Sure 

IF  YOU  WORK IN  PERMIT  PROCESSING  SERVICES,  PLEASE  ANSWER  QUESTIONS  69  through  71 

69.  Which  area  in  Permit  Processing  Services  do  you  work  in? 

a.  G One-Stop/Express  b.  G Central  Permit  Bureau  c.  G Technical  Services 

70.  Check  the  box  that  best  describes  your  workload. 

a.  G Manageable  b.  G Barely  Manageable  c.  G Unmanageable 

71.  If  you  work  in  permit  processing  services  and  you  checked  box  b.  or  c.  in  question  70,  describe  what 
change(s)  could  be  made  to  improve  the  manageability  of  your  workload: 


Strongly  Agree  Disagree  Strongly  Not  Sure 
Agree  Disagree 

72.  All  Permit  Services  Employees  (circle 

one):  1 2 3 4 X 

DBI  has  placed  too  much  emphasis  on 
customer  service. 


73.  If  you  answered  “1”  or  “2”  for  question  72,  please  provide  an  example  of  how  the  department 
overemphasizes  customer  service: 
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**** Questions  74-91  are  for  Inspection  Services  Employees  Only  ********** 


Inspection  Services 


IF  YOU  ARE  A BUILDING,  PLUMBING,  OR  ELECTRICAL  INSPECTOR,  PLEASE  ANSWER 
QUESTIONS  74  THROUGH  85: 

74.  How  many  inspections  on  average  do  you  conduct  each  day? 

a.  □ 1-5  b.G6-10  c.  dll  or  more 

75.  How  many  inspections  per  day  do  you  consider 

reasonable?  

76.  The  number  of  inspections  I am  expected  to  conduct  is: 
a.  □ Too  high  b.  □ Reasonable  c.  □ Too  low 

77.  If  you  consider  the  number  of  inspections  you  conduct 
to  be  too  high  or  too  low,  what  changes(s)  should  be 
made? 

78.  In  general,  do  you  inspect  to  the: 

a.  □ Approved  plans  b.  □ Applicable  codes  c.  □ Both 

79.  Have  you  witnessed  customers  receiving  improper  preferential  treatment? 

a.  OYes  b.  CJNo  c.  □ Not  Sure 

80.  Has  a supervisor  ever  asked  you  to  give  a customer  improper  preferential  treatment? 

a.  DYes  b.  CUNo  c.  □ Not  Sure 

81.  How  often  do  you  deal  with  expediters  hired  by  customers? 

a.  □ Every  day  b.  □ At  least  once  a week  c.  □ At  least  once  a month  d.  □ Rarely  e.  □ Never 

Inspectors:  Answer  questions  82  and  83  only  if  you  did  not  answer  “Never”  to  question  81. 

82.  Has  an  expediter  hired  by  a customer  ever  asked  you  for  improper  preferential  treatment? 

a.  OYes  b.  ONo  c.  □ Not  sure 

83.  Have  you  ever  witnessed  an  expediter  receiving  improper  preferential  treatment? 

a.  ClYes  b.  iTJNo  c.  □ Not  Sure 

84.  If  you  work  in  Code  Enforcement,  Disabled  Access,  and  Health  & Safety,  how  would  you  assess  your 
workload? 

a.  □ Manageable  b.  □ Barely  Manageable  c.  □ Unmanageable 
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85.  If  you  checked  box  b.  or  c.  in  question  84,  describe  what  changes  could  be  made  to  improve  the 
manageability  of  your  workload. 


IF  YOU  ARE  A HOUSING  INSPECTOR,  ANSWER  QUESTIONS  86  THROUGH  89: 

86.  How  many  housing  inspections  do  you  conduct  on 

average  each  day?  (circle  one):  12345678910 

87.  How  many  inspections  per  day  do  you  consider 

reasonable?  

88.  If  you  consider  the  number  of  inspections  you  

conduct  to  be  more  than  reasonable,  what 

change(s)  should  be  made? 

89.  Estimate  the  percentage  of  your  time  you  spend  trying  to  collect  fees  billed  to  landlords  for  costs  of 
enforcement  actions? 

a.  □ 0%  b.  □ 1 0%  to  15%  c.  □ 1 5%  to  20%  d.  □ More  than  20% 


All  Inspection  Services  Employees  answer 
questions  90  and  91: 

90.  DBI  has  placed  too  much  emphasis  on  customer 

service  (circle  one).  1 2 3 4 X 

91.  If  you  answered  “1”  or  “2”  for  question  90,  please  provide  an  example  of  how  the  department 
overemphasizes  customer  service: 


^ *: 3?* ''  ~'7r r- 7 

Strongly  Agree  Disagree  Strongly  Not  Sure 
Agree  Disagree 


That's  all!  Please  put  your  completed  questionnaire  in  the  attached 
envelope  and  drop  it  into  one  of  the  sealed  collection  boxes  located  on 
each  floor.  


Thank  you  for  completing  the  survey! 
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Executive  Summary 


This  report  presents  findings  of  the  San  Francisco  Department  of  Building  Inspection 
Customer  Survey  conducted  in  January  2001  by  San  Francisco  State  University’s  Public 
Research  Institute  for  the  City  and  County  of  San  Francisco’s  Controller’s  Office.  The 
survey  was  intended  to  help  the  Controller’s  Office  evaluate  the  effectiveness  and 
efficiency  of  the  Department  of  Building  Inspection  (DBI)  as  mandated  by  the  City 
Charter. 

The  project’s  goal  was  to  survey  recent  customers  of  San  Francisco’s  DBI  to  determine  the 
quality  of  their  experience  with  various  departmental  services  and  personnel.  All 
customers  identified  by  DBI  as  contractors  who  had  applied  for  a permit  with  DBI  between 
June  and  December  2000  were  mailed  an  anonymous  2-page  questionnaire  that  asked 
respondents  to  provide  information  regarding  their  most  recent  experience  with  the 
following  DBI  procedures  and  services: 

• Permit  application  process; 

• Plan  check  and  permit  processing; 

• Inspection  scheduling  and  inspection  services;  and 

• Overall  experience  with  DBI  in  the  past  year. 

On  January  9,  2001,  the  Public  Research  Institute  mailed  introductory  letters, 
questionnaires  and  self-addressed  stamped  envelopes  to  2,502  customer  addresses 
provided  by  DBI.  A follow-up  reminder  postcard,  mailed  to  all  2,502  customers  on 
January  23,  prompted  22  telephone  requests  for  an  additional  copy  of  the  questionnaire.  By 
February  12,  the  Public  Research  Institute  had  received  576  completed  surveys  from  2,303 
DBI  customers  with  deliverable  addresses,  representing  a 25%  response  rate. 

The  Public  Research  Institute  analyzed  the  DBI  customer  survey  data,  and  major  findings 
of  this  analysis  are  summarized  below. 

• Most  customers  (85%)  reported  the  purpose  of  their  most  recent  contact  with  DBI 
was  to  apply  for  a permit,  and  44%  of  respondents  indicated  more  than  one  purpose 
for  their  business. 

• Of  those  customers  who  indicated  the  type  of  permit  sought,  55%  sought  electrical 
permits  and  46%  sought  plumbing  or  mechanical  permits.  Twenty  percent  of 
respondents  indicated  more  than  one  type  of  permit.  Of  customers  who  reported  the 
type  of  project,  79%  sought  permits  for  residential  projects. 

• Contractors  represented  82%  of  the  sample,  and  78%  of  respondents  were  frequent 
DBI  customers  who  applied  for  permits  at  least  four  times  per  year.  Nearly  half  of 
all  respondents  (48%)  applied  for  permits  10  or  more  times  per  year. 

• Most  customers  (65%)  rated  DBI’s  permit  application  services  good  or  excellent, 
and  40%  had  experienced  no  problems  during  the  application  process.  Of  323 
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customers  who  had  experienced  problems  processing  their  applications,  243  (75%) 
were  able  to  satisfactorily  resolve  them  with  DBI. 

• Most  respondents  (86%)  felt  DBI  staff  had  been  helpful  and  courteous  during  the 
application  process. 

• Only  17%  of  the  cost  of  work  estimates  submitted  by  customers  had  been  raised  by 
DBI. 

• Although  most  customers  (74%)  reported  their  permits  had  been  issued  within  7 
days  of  their  application,  49%  of  all  customers  experienced  delays  during  the  plan 
check  or  application  review  process,  and  38%  of  these  customers  felt  DBI  staff  had 
not  been  helpful  in  minimizing  the  delays.  Most  customers  (78%)  felt  they  had  been 
promptly  notified  about  required  corrections  or  changes. 

• The  majority  of  customers  (65%)  felt  it  was  somewhat  or  very  easy  to  make 
inspection  appointments  and  contact  or  meet  with  inspectors.  However,  15%  of 
customers  felt  making  appointments  was  somewhat  or  very  difficult,  and  16%  felt 
contacting  inspectors  was  somewhat  or  very  difficult. 

• Customers  who  sought  residential  permits  felt  inspection  appointments  were  harder 
to  make  than  those  not  seeking  these  types  of  permits.  Those  who  felt  they  had 
received  excellent  service  during  the  permit  application  process  were  more  likely  to 
rate  their  access  to  inspection  services  as  very  easy. 

• Most  customers  agreed  or  strongly  agree  that  inspectors  with  whom  they  had  worked 
were  professional,  fair  and  competent,  and  of  these  performance  attributes, 
inspectors’  professionalism  received  the  highest  ratings.  Nearly  half  of  all 
respondents  (46%)  strongly  agreed  inspectors  were  professional,  while  43%  and 
40%  strongly  agreed  they  were  competent  and  fair,  respectively. 

• Electrical  permit  applicants  tended  to  rate  inspectors  somewhat  lower  than  non- 
electrical customers  on  all  three  performance  dimensions.  Customers  who  felt 
inspection  appointments  were  easy  to  make  and  inspectors  easy  to  contact  were  more 
likely  to  rate  inspectors  highly  professional,  fair  and  competent. 

• Of  537  respondents,  27%  said  they  had  experienced  no  problems  with  DBI’s  service 
in  the  past  year,  26%  had  experienced  one  type  of  problem  and  1 0%  had  experienced 
four  or  more  problem  types.  Of  537  respondents,  35%  said  they  felt  inspectors  were 
inconsistent  and  29%  felt  permit  approval  took  too  long. 

• Overall,  65%  of  customers  felt  they  had  received  good  or  excellent  service  from  DBI 
in  the  past  year,  while  only  9%  characterized  services  as  poor  or  very  poor. 
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Summary  of  Selected  Responses 

Note:  There  were  137  questionnaires  returned  out  of 284  that  were  distributed,  for  a 
response  rate  of  48  percent. 


The  Department  Overall 

• Employees  feel  the  department  has  made  good  progress  toward  improving  the  quality 
of  life  in  San  Francisco  and  about  the  department’s  improvements  in  customer 
service. 

• Employees  feel  that  management  has  effectively  communicated  the  department’s 
goals  and  objectives  to  staff.  Employees  also  feel  the  department  is  fulfilling  its 
mission. 

My  Job,  My  Supervisor,  and  Department  Management 

• Employees  are  satisfied  with  their  jobs  and  feel  that  productivity  in  their  work  units 
has  improved  in  the  last  2 years. 

• Although  59  percent  of  employees  feel  the  department  is  well  managed,  30  percent 
disagree.  However,  approximately  80  percent  of  employees  feel  their  own  work  units 
are  well  managed,  and  that  their  divisions’  management  has  high  standards  and 
expects  high  quality  work. 

• Employees  feel  that  they  know  what  supervisors  expect  of  them  and  they  can  rely  on 
their  supervisors  or  on  policies  and  procedures  to  provide  reliable,  up-to-date 
information. 

• Although  60  percent  of  employees  feel  that  management  seeks  out  the  opinions  and 
suggestions  of  its  employees,  29  percent  disagree.  Similarly,  65  percent  feel  that 
communication  between  management  and  employees  is  good  while  28  percent 
disagree. 

• Although  67  percent  of  employees  feel  the  department’s  policies  and  procedures  are 
clearly  defined  and  consistently  applied,  28  percent  disagree. 

Training 

• Employees  are  satisfied  with  the  training  and  development  opportunities  they  receive. 
However,  while  52  percent  of  employees  who  use  the  department’s  permit  tracking 
system  feel  they  have  received  sufficient  training  to  use  it  effectively,  43  percent 
disagree.  Further,  while  61  percent  of  employees  who  use  the  point  of  sale  system 
feel  they  have  received  sufficient  training  to  use  it  effectively,  33  percent  disagree. 
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• Ninety-four  percent  of  employees  use  computers  in  their  work.  Sixty-two  percent  of 
employees  feel  computer  training  is  adequate,  but  33  percent  disagree.  Further,  while 
52  percent  feel  technical  support  is  adequate,  40  percent  feel  it  is  not. 

Organizational  Change,  Pride,  and  Performance 

• Employees  feel  they  are  receptive  to  and  ready  for  changes  in  the  department  and 
changes  currently  being  made  are  needed  to  make  the  department  function  more 
effectively.  However,  while  50  percent  of  employees  indicated  that  management  is 
open  to  change,  33  percent  disagreed. 

• Respondents  said  that  employees  of  the  department  are  proud  of  their  work  and  proud 
to  tell  people  they  work  for  the  department.  Further,  employees  indicated  that  morale 
in  their  work  units  is  high.  However,  while  57  percent  of  employees  indicated  that 
morale  in  the  department  as  a whole  was  good,  35  percent  indicated  it  was  not. 
Employees  who  indicated  that  morale  was  not  good  cited  reasons  such  as  poor 
communication  with  and  lack  of  support  from  management,  concerns  about  the 
influence  of  outside  or  special  interests  on  the  department,  and  concerns  that  hiring 
and  promotions  are  not  conducted  fairly. 

• Forty  percent  of  employees  indicated  they  had  had  a performance  appraisal  in  the  last 
year,  but  41  percent  indicate  they  had  not,  and  19  percent  indicated  they  had  never 
had  a performance  appraisal. 

Areas  for  Improvement  and  Change 

• Employees  indicated  that  the  3 most  critical  areas  for  the  department  to  address  are 
workload,  management  and  staff  relations,  and  compensation. 

• Employees  indicated  what  they  like  best  about  working  for  the  department  is  the 
professionalism  and  friendliness  of  co-workers,  helping  the  public  and  ensuring 
public  safety,  and  the  jobs  they  hold  or  the  type  of  work  they  do. 

• Employees  indicated  that  the  department’s  services  could  be  improved  with  better 
customer  services  training  for  employees  and  extended  office  hours  for  permit 
processing. 

• Some  (65  percent)  of  the  responding  employees  indicated  the  one  thing  they  would 
change.  Responses  covered  many  topics,  with  the  most  common  one  being 
eliminating  favoritism — both  in  response  to  outside  influences  and  in  hiring  and 
promotion  of  department  employees  (19  responses).  Other  changes  employees 
frequently  cited  included  improving  the  reliability  of  the  department’s  computer 
systems  and  improving  the  automated  phone  system  (1 1 responses),  more  and  better 
training  (9  responses)  and  adding  more  workspace  as  well  as  a break  room  and  library 
(9  responses). 
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Permit  Services  Division  Employees 

• Permit  Services  Division  plan  checkers  report  that  they  check  an  average  of  3.4  plans 
per  day,  consistent  with  the  department’s  goals  of  3 commercial  plans  and  4 
residential  plans  per  day,  but  they  feel  2.6  plans  per  day,  on  average,  is  more 
reasonable.  Also,  plan  checkers  are  evenly  divided  over  whether  their  workloads  are 
manageable  or  barely  manageable. 

• Almost  one-third  of  plan  checkers  (7  of  22)  feel  too  much  of  their  time  is  spent 
performing  non-work  related  activities,  including  answering  inquiries  from  people 
other  than  customers. 

• Twenty-nine  percent  of  plan  checkers  (6  of  21)  indicated  they  have  witnessed 
customers  receiving  improper  preferential  treatment  and  25  percent  (5  of  20)  said  that 
supervisors  had  asked  them  to  do  so. 

• Over  half  of  plan  checkers  (11  of  2 1 ) indicated  they  deal  with  outside  expediters 
every  day  and  one-third  indicated  they  deal  with  expediters  at  least  once  a week. 

• Over  one-quarter  of  (6  of  23)  plan  checkers  indicated  that  outside  expediters  had 
asked  them  for  improper  preferential  treatment. 

• Most  Permit  Services  Division  employees  indicated  their  workloads  are  manageable. 

• When  asked  if  the  department  places  too  much  emphasis  on  customer  service,  43 
percent  of  Permit  Services  Division  employees  agreed  and  53  percent  disagreed. 

Inspection  Services  Division  Employees 

• The  majority  of  inspectors  report  that  the  average  number  of  inspections  they  conduct 
per  day  is  1 1,  consistent  with  the  department’s  performance  measures,  but  they  feel  9 
inspections  per  day,  on  average,  is  more  reasonable. 

• Inspectors  generally  feel  their  workloads  are  reasonable,  but  those  who  do  not 
suggested  changes  such  as  less  emphasis  on  quantity  or  number  of  inspections,  better 
distribution  of  workload,  more  staff,  smaller  inspection  districts,  and  performance 
measures  that  require  fewer  inspections  per  day  and  that  take  more  complex 
inspections  into  consideration. 

• Forty-six  percent  of  (12  of  26)  inspectors  indicated  they  have  witnessed  customers 
receiving  improper  preferential  treatment  while  38  percent  indicated  they  had  not. 

• Over  one-third  of  (1 0 of  27)  inspectors  indicated  a supervisor  had  asked  them  to  give 
a customer  improper  preferential  treatment. 


CONTROLLER’S  AUDITS  DIVISION 


D-3 


Appendix  D 

Department  of  Building  Inspection  Employee  Survey 

Summary  of  Selected  Responses 

• One-third  of  (9  of  27)  inspectors  indicated  they  deal  with  expediters  at  least  once  a 
month. 

• Almost  one-third  of  (7  of  22)  inspectors  indicated  that  an  expediter  hired  by  a 
customer  had  asked  them  for  improper  preferential  treatment. 

• Almost  one-third  of  (7  of  22)  inspectors  indicated  that  they  had  witnessed  expediters 
receiving  improper  preferential  treatment. 

• The  majority  of  inspectors  who  work  in  code  enforcement,  disabled  access,  and 
health/safety  indicated  their  workloads  were  manageable. 

• Inspections  Services  Division  employees  generally  do  not  believe  the  department 
places  too  much  emphasis  on  customer  service. 

Housing  Inspection  Services  Employees 

• Most  housing  inspectors  indicated  they  conduct,  on  average,  6 inspections  per  day, 
but  think  that  5 inspections  per  day  would  be  a reasonable  expectation. 
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EXECUTIVE  SUMMARY 
I.  Results  in  Brief 

The  Department  of  Building  Inspection  (DBI)  is  in  business  to  review  plans, 
perform  inspections,  and  issue  permits.  DBI  exhibits  a strong  customer  service 
ethic  but  requires  much  improvement  in  its  key  processes  of  permit  issuance  and 
inspection. 

1 Permit  Accuracy  and  Efficiency.  The  DBI  should  eliminate  minor  quality  control 
gaps  in  the  permit  issuance  process  that  raise  the  risk  of  substandard  construction. 

■ A review  of  20  applications  revealed  that  35%  were  returned  after  quality 
checks  identified  missing  reviews,  approval  signatures,  or  outstanding  code 
complaints. 

■ Permit  fee  calculations  were  generally  accurate  as  a review  of  25  fee 
receipts  found  over/short  errors  representing  only  0.1%  of  the  total 
collected. 

■ Inadequate  documentation  related  to  plan  changes  in  the  One  Stop  process 
which  may  affect  code  compliance,  was  noted,  but  no  estimate  of  the 
frequency  of  this  condition  could  be  determined  from  available 
documentation. 

■ Employee  survey  results  indicated  that  50%  of  staff  felt  training  was  not 
adequate. 

2 Permit  Timeliness.  The  DBI  should  address  process  and  technology  issues  that 
delay  permit  issuance. 

■ Twenty  percent  of  a 1600  “behind-the-counter”  plan  sample  required  30 
minutes  or  less  for  review,  indicating  that  more  plans  can  be  reviewed  and 
approved  “over-the-counter”. 

■ Current  division  of  plan  review  responsibilities  between  the  inspector  and 
engineer  job  positions  contribute  to  delays  in  permit  issuance. 

■ Lack  of  reliable  performance  measure  data  make  management 
identification  of  process  bottlenecks  difficult. 

■ Recent  improvements  in  supporting  information  technology  (Motorola  to 
Oracle)  have  reduced  system-related  work  slow-downs  from  almost  daily 
to  once  weekly  occurrences,  however  additional  improvement 
opportunities  exist. 

3 Inspection  Productivity.  Insufficient  use  of  technology  and  quality  controls 
hamper  inspector  productivity  and  responsiveness. 

■ The  inspection  records  process  relies  on  manual  note-taking,  requiring 
multiple  transfers  of  data  by  inspectors  and  clerks. 

■ The  current  data  collection  protocol  for  tracking  inspection  performance 
lacks  sufficient  checks  to  ensure  accuracy. 

■ Quality  control  procedures  for  inspections  do  not  favorably  compare  to  the 
best  jurisdictions. 
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■ DBI  has  the  least  aggressive  response  time  targets  for  inspections  of  the  9 
jurisdictions  surveyed. 

■ Limited  improvements  in  the  use  of  technology  have  reduced  clerical  paper 
processing  workloads,  saving  approximately  8,800  hours  yearly  and 
allowing  more  customer  contact,  however  additional  improvement 
opportunities  exist. 

4.  Customer  Service.  Although  interviews  indicate  that  management  and  staff 

emphasize  customer  service  as  a priority,  front-line  contact  with  DBI  customers  is 
inefficient  and  inconvenient. 

■ Review  found  that  the  three  inspection  divisions  have  inconsistent  hours 
and  procedures  for  customers  to  schedule  inspections. 

■ Analysis  of  Customer  Service  staff  activity  indicated  that  75-85%  of  calls 
relate  to  the  same  set  of  questions  and  could  be  addressed  with  an  initial 
automated  response. 

■ Responses  to  customer  questions  on  code  interpretation  are  sometimes 
inconsistent,  and  take  an  estimated  6,600  hours  of  plan  review  staff  time 
annually,  to  the  detriment  of  fulfilling  normal  job  responsibilities. 

Key  Recommendations. 

1 . Add  controls  to  ensure  permit  applications  are  thoroughly  and  accurately 
reviewed.  Result : Increased  assurance  of  building  safety. 

2.  Research  One  Stop  process  complaints  and  train  One  Stop  Permit  division 
staff  to  remedy.  Result : More  efficient  permit  issuance  process. 

3.  Assess  potential  for  greater  engineering  staff  involvement  in  the  plan 
check  process  during  initial  counter  screening.  Result : More  plans 
approved  while  the  customer  waits;  improved  customer  service. 

4.  Consider  replacing  inspector  positions  involved  in  the  plan  review  process 
with  junior  engineering  staff.  Result : Fewer  re-reviews  of  plans;  more 
efficient  plan  review  process 

5.  Acquire  existing  paperless  technology  to  streamline  the  inspection  records 
process.  Result:  Less  manual  paper  work;  greater  inspector  productivity. 

6.  Revise  data  collection  protocol  to  improve  the  reliability  of  plan  review 
and  inspection  performance  measures.  Result:  Increased  ability  to  identify 
and  remedy  productivity  and  responsiveness  issues 

7.  Improve  the  quality  audit  system  for  inspections  and  review 
responsiveness  targets.  Result:  Decreased  risk  of  non-compliant 
construction  and  improved  customer  service. 

8.  Standardize  customer  service  hours  for  scheduling  Building,  Plumbing 
and  Electrical  inspections.  Result:  Improved  customer  service. 

9.  Install  an  IVR  system  to  handle,  track  data  on  incoming  phone  calls. 
Result:  Reduced  customer  wait  times;  more  efficient  staff  usage. 

10.  Refer  all  code  related  questions  to  Technical  Services  staff . Result: 
Improved  customer  service;  greater  plan  review  productivity 
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II.  Background 

In  November  1994,  the  voters  of  the  City  and  County  of  San  Francisco  passed 
Proposition  G removing  the  Bureau  of  Building  Inspection  from  the  Department  of 
Public  Works  and  establishing  it  as  a separate  City  department.  The  Department  of 
Building  Inspection  (DBI)  is  responsible  for  a wide  variety  of  services,  including  the 
inspection  of  buildings  and  structures  for  compliance  with  related  codes  and  regulations; 
reviewing  plans  for  conformance  with  related  codes  and  regulations;  approving  and 
issuing  permits,  updating  microfilm  records,  and  processing  Residential  Records  reports. 

The  services  provided  by  the  Department  are  funded  entirely  from  fee  revenues  relating 
to  plan  checking,  permitting  and  licensing.  To  support  these  important  services,  the 
Department  also  provides  administrative  support  and  general  management  activities  such 
as  financial  planning,  budgeting,  purchasing,  accounting,  human  resources  management, 
and  customer  services.  Both  these  services  and  activities  combine  to  create  a complex 
and  sophisticated  organization. 

The  CCSF  DBI  faces  a unique  set  of  challenges  in  the  execution  of  its  mission. 
Geographical  challenges  in  San  Francisco  include  an  expansive  waterfront,  wide 
differences  in  elevation,  and  significant  seismographic  concerns.  These  natural  factors, 
combined  with  those  that  are  man-made  such  as  the  countless  types  of  residential  and 
commercial  construction  and  the  rebounding  high  rise  construction  industry,  would  seem 
to  be  enough  of  a challenge.  In  addition  to  both  these  conditions,  the  Department  must 
satisfy  a very  active  and  vocal  political  electorate,  making  the  efficiency  and 
effectiveness  of  this  public  entity  a paramount  public  concern. 


III.  DBI  Should  Better  Control  Permit  Issuance  to  Ensure  Accuracy  and 

Efficiency.  The  DBI  should  eliminate  minor  quality  gaps  in  the  permit  issuance 
process  that  raise  the  risk  of  substandard  construction  and  improve  training.  The 
potential  for  incomplete  reviews  or  errors  in  the  permit  process  can  be  better 
controlled,  reducing  the  risk  of  substandard  building  construction. 

a.  Condition : We  reviewed  a sample  of  20  internal  checklists  used  to  assess  the 
completeness  of  permit  applications  before  issuance.  We  found  that  20%  had 
not  undergone  necessary  reviews  by  the  Mechanical  Plan  Check  section  or 
were  missing  approval  signatures.  An  additional  15%  of  applications 
involved  properties  with  unresolved  code  complaints  requiring  Housing 
Inspection  investigation.  Cause.  Routing  and  procedural  oversights  persist  in 
the  plan  review  process.  Effect : Oversights  increase  risk  of  non-compliant 
construction  and  the  need  to  return  plans  for  missed  approvals,  signatures  or 
investigations  increases  overall  plan  review  time. 
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b.  Condition : The  current  One  Stop  permit  review  process  does  not  ensure  the 
re-review  of  all  plan  changes  which  may  effect  code  compliance.  However, 
no  estimate  of  the  frequency  of  this  condition  could  be  determined  from 
available  documentation.  Cause.  The  current  process  does  not  route  plans 
with  changes  back  to  non-DBI  City  departments  for  re-review.  Effect:  This 
condition  contributes  to  an  increased  risk  of  approval  of  non-compliant 
construction. 

c.  Condition : Our  interviews  with  Plan  Check  staff  indicated  that  several 
believe  One  Stop  staff  often  do  not  collect  adequate  initial  documentation 
from  applicants  or  accurately  transfer  plan  comments  to  final  approved  plan 
sets  returned  to  the  applicant.  However,  this  perception  could  not  be 
substantiated  by  a review  of  available  documentation.  Cause:  The  One  Stop 
permit  coordinator  positions  may  lack  sufficient  plan  evaluation  skills  and 
training  to  ensure  the  completeness  of  each  task.  Effect:  This  condition  could 
contribute  to  re-work  by  plan  review  professionals  and  raise  the  risk  of 
inadvertent  approval  of  substandard  construction. 

d.  Condition:  We  identified  1 instance  of  inadequate  fee  assessment  and  1 
instance  of  excessive  fee  assessment  for  minor  amounts  in  a sample  of  25 
plumbing,  electrical,  building  and  plan  check  fee  assessment  receipts.  Each  of 
these  errors  represented  a negligible  amount  (1/10%)  of  the  total  fees  in  the 
receipt  sample.  Cause:  Assessment  of  fees  by  Central  Permit  Bureau  staff 
are  generally  accurate.  Effect i If  the  error  rate  in  the  sample  is  applied  to  the 
$30,239,935  in  fees  collected  in  FY  1998-1999,  it  would  represent  $37,1 16  in 
lost  revenues  annually. 

e.  Condition:  Our  July  1999  survey  of  management  and  select  staff  indicated 
that  50%  believe  training  received  was  not  adequate  or  valuable.  Cause: 
Specifically,  those  who  commented  felt  that  state  mandated  courses  did  not 
provide  adequate  knowledge  to  perform  most  job  duties.  Effect:  Inadequate 
training  increases  the  risk  that  permits  are  issued  based  on  incomplete  (or 
inefficient)  reviews  of  building  plans. 


IV.  DBI  Should  Issue  Permits  Faster.  The  DBI  should  address  process  issues  that 
delay  plan  review  and  permit  issuance.  Performance  data  gathered  shows 
inconsistencies  and  is  of  limited  use  to  management  in  identifying  process 
bottlenecks. 

a.  Condition:  A significant  number  of  plans  taken  in  for  ‘behind  the  counter’ 
reviews  may  be  suitable  candidates  for  ‘over  the  counter’  review.  Our  review 
found  up  to  20%  of  plan  reviews  by  DBI  reviewers  took  30  minutes  or  less, 
and  3%  of  such  reviews  took  15  minutes  or  less.  Cause:  Current  use  of  plan 
review  professional  staff  at  service  counters  and  screening  procedures  may  not 
maximize  the  number  of  plans  able  to  be  reviewed  over  the  counter.  Effect: 
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The  practice  of  taking  more  plans  for  ‘behind-the-counter’  reviews  increases 
plan  backlogs  and  lengthens  the  overall  permit  issuance  process. 

b.  Condition:  The  Department  employs  inspector  positions  in  addition  to 
engineers  to  review  certain  elements  of  construction  plans.  This  plan  review 
role  for  inspector  positions  enjoys  strong  union  backing.  Interviews  suggest 
that  inspectors  are  sometimes  unable  to  review  those  plan  elements  assigned 
to  them  to  the  satisfaction  of  engineers  who  re-review  these  before  issuing 
final  plan  approvals.  However,  the  extent  of  this  condition  could  not  be 
estimated  by  a review  of  the  associated  documentation.  Cause:  The  use  of 
inspectors  to  perform  an  initial  first  review  of  plans  followed  by  secondary 
reviews  of  engineers  does  not  appear  to  be  efficient  or  cost  effective.  Effect: 
This  condition  contributes  to  increased  plan  review  and  therefore  permit 
issuance  times. 

c.  Condition:  While  the  Department’s  system  for  measuring  performance  of 
plan  review  compares  well  with  other  jurisdictions,  we  found  inconsistent  data 
collection  and  calculation  practices  in  our  reviews  of  both  1999  and  2000 
data.  Cause:  Operations  staff  miss  or  fail  to  enter  plan  routing  dates 
consistently  at  various  stages  of  the  plan  review  process.  Effect:  Unreliable 
performance  measurement  data  limit  management’s  ability  to  pinpoint  and 
remedy  process  bottlenecks. 

d.  Condition:  Use  of  the  Oracle  2000  and  legacy  Oracle  systems  has  replaced 
the  segmented  usage  of  different  information  systems  for  different  divisions 
throughout  the  Department.  Cause:  A new  Oracle  2000  system  has  been 
introduced  to  replace  the  legacy  Motorola  system,  and  is  scheduled  to  also 
replace  legacy  Oracle  applications.  Effect:  Inefficiencies  associated  with  the 
use  of  different  systems  and  lost  work  time  due  to  system  ‘freezes’  or  ‘slow 
downs’  have  been  reduced,  however  more  recent  fieldwork  reveals 
opportunities  for  improvement  remain. 


V.  DBI  Should  Increase  Inspection  Productivity  and  Responsiveness. 

Insufficient  use  of  technology  and  unreliable  data  gathering  practices  hamper 
inspector  productivity  and  responsiveness.  The  DBI  emphasizes  customer 
responsiveness  but  had  the  lower  inspection  response  time  targets  than  other 
jurisdictions  surveyed.  While  we  did  not  attempt  to  assess  the  accuracy  of 
inspections,  we  found  that  DBFs  quality  control  procedures  for  inspections  did 
not  compare  to  the  best  jurisdictions. 

a.  Condition  . During  ‘ride-alongs’  with  DBI  inspectors,  we  observed  three 
separate  transfers  of  information  by  hand  from  paper  site  card  to  paper  job 
card  to  paper  report  and  finally  to  the  Oracle  system.  Cause.  The  DBFs 
inspection  records  process  is  paper  driven,  manually  intensive  and  does  not 
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employ  available  technology.  Effect : Time  spent  on  multiple  manual 
transfers  of  data  adversely  effects  inspector  productivity. 

b.  Condition:  Our  September  2000  review  confirmed  our  1999  observations. 
Data  is  subject  to  reporting  error  and  involves  time  consuming  calculation. 
Cause:  No  consistent  definition  of  what  constitutes  a single  inspection  exists, 
data  gathering  relies  on  self-reporting  with  no  automated  verification,  and 
calculation  of  final  performance  measure  figures  relies  on  multiple  manual 
transfers  of  data.  Effect:  Areas  of  sub-par  inspection  performance  may 
remain  hidden  and  actions  to  improve  overall  inspection  responsiveness  may 
be  misplaced. 

c.  Condition:  Since  the  DBFs  48-hour  inspection  response  time  target  is  less 
aggressive  than  the  24-hour  target  used  in  the  other  jurisdictions  surveyed, 
performance  results,  indicating  targets  are  met  or  exceeded,  may 
inappropriately  indicate  comparable  productivity  Cause:  A combination  of 
limited  technology  to  aid  customer  access  and  lack  of  training  may  contribute 
to  the  DBFs  lower  response  time  target.  Effect:  The  current  target  is  likely  to 
limit  the  level  of  service  to  DBI  customers. 

d.  Condition:  The  current  system  for  auditing  inspection  quality  risks 
subjectivity  in  audit  results.  Additionally,  the  DBI  does  not  make  use  of  such 
information  gained  by  quality  audits  to  identify  technical  training 
requirements  of  its  employees.  Cause:  Unlike  the  best  jurisdictions 
surveyed,  the  department  relies  on  supervisors  to  audit  the  quality  of 
inspections  of  inspectors  reporting  directly  to  them  rather  than  utilizing  cross- 
section  checks.  The  DBI  uses  a request-driven  system  to  identify  training 
needs.  Effect:  Although  no  quality  issues  were  identified,  the  current  system, 
lacking  in  scheduled  periodic  reviews,  increases  the  risk  that  lapses  in 
inspection  quality  may  be  overlooked. 

e.  Condition  : The  automation  of  the  production  of  initial  inspection  job  cards 
using  the  Oracle  2000  system  has  eliminated  an  estimated  8,800  hours,  1 100 
work  days  or  four  FT’Es  in  clerical  staff  effort  identified  in  our  June  1999 
review.  Cause : The  introduction  of  the  Oracle  2000  system  has  automated 
what  was  previously  a manual  task  under  the  old  Motorola  system.  Effect: 
Time  previously  spent  by  Central  Permit  Bureau  staff  on  the  production  of  job 
cards  is  now  available  to  attend  to  the  needs  of  Department  customers. 

VI.  The  DBI  Should  Improve  Customer  Service  Through  Automation  and 

Coordination  Although  management  and  staff  emphasize  customer  service  as  a 
priority;  inconvenient  access  hours,  a lack  of  technology  and  a lack  of  internal 
coordination  contribute  to  inefficient  and  inconvenient  front-line  contact  with 
customers. 
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a.  Condition:  DBI  customers  must  cope  with  different  schedules  and 
procedures  to  request  an  inspection  from  each  of  three  inspection  divisions 
-Plumbing,  Electrical  and  Building.  Each  division  maintains  separate 
hours  within  which  customers  may  call  in  to  request  inspections.  In  some 
divisions,  inspectors  must  speak  directly  to  customers  to  confirm 
inspection  times;  in  others  administrative  support  staff  can  do  this.  Cause: 
Inconsistent  service  hours  and  scheduling  procedures  exist.  Technology 
such  as  voice  mail  or  automated  scheduling  to  support  customer  access  is 
not  in  place. 

Effect:  These  varied  procedures  complicate  customer  attempts  to 
schedule  inspections. 

b.  Condition:  Our  observations  of  Customer  Service  staff  indicate  that 
routines  for  responding  to  incoming  customer  phone  calls  are  not  efficient 
in  their  use  of  either  Customer  Service  or  professional  staff  time.  Cause: 
Lack  of  appropriate  technology  and  insufficient  training  contribute  to  the 
inefficient  handling  of  customer  calls. 

1.  The  Department  does  not  use  an  IVR  (Interactive  Voice  Response) 
system  to  handle  incoming  calls,  requiring  a staff  person  to  respond  to 
each  individually.  Based  on  our  observations  of  Customer  Service 
staff,  approximately  80%  of  time  of  the  three  staff  persons,  or  2.4  Ht, 
is  dedicated  to  incoming  calls.  Additionally,  without  an  IVR  system 
the  DBI  is  unable  to  collect  data,  e.g.  call  volumes  or  inquiry  type,  to 
design  effective  strategies  for  handling  incoming  calls. 

2.  No  touch-tone  or  recorded  message  system  exists  to  inform  customers 
of  the  status  of  their  plans  in  the  plan  review  process,  although  this 
information  is  recorded  electronically.  Observations  reveal  that 
approximately  75-85%  of  incoming  calls  are  inquiries  about  plan 
status. 

3.  Calls  are  misdirected  to  line  and  professional  staff  contributing  to 
wasted  staff  time  and  multiple  transfers  of  customer  calls.  Analysis  of 
plan  review  staff  and  CPB  staff  comments  indicate  that  many  calls  are 
misdirected.  One  manager  indicated  that  a third  of  the  calls  received 
involved  queries  that  could  be  handled  by  Customer  Service  staff. 

Effect:  Although  no  reliable  data  is  available.  Customer  Service  staff 
themselves  estimate  customer  wait  times  of  up  to  10  minutes  in  peak 
periods,  and  staff  complaints  of  interruptions  from  misdirected  calls  were 
frequent. 

c.  Condition:  Procedures  for  handling  inquiries  on  code  interpretation  leave 
room  for  conflicting  advice  to  customers  and  disrupt  plan  review 
workloads. 

Cause:  The  current  assignment  of  responsibilities  and  lack  of 
coordination  contributes  to  this  condition. 

1.  Two  different  staff  groups,  the  Technical  Services  as  well  as  the 
Plan  Check  divisions,  answer  code  interpretation  inquiries  but  no 
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mechanism  exists  to  ensure  interpretations  provided  to  the  public 
are  consistent.  Both  interview  and  focus  group  comments  indicate 
that  responses  provided  to  customers  by  the  two  groups  can 
conflict.  However,  our  review  found  no  documentation  available 
to  substantiate  the  frequency  of  this  condition. 

2.  Our  sample  inquiry  of  4 plan  review  professionals  who  answer 
general  code  interpretation  questions  indicates  that  an  average  of 

0.7  hours  is  spent  daily  on  this  task.  If  this  average  is  extended  to 
all  33  plan  reviewers  on  an  annual  basis,  a total  of  3 FTE  hours 
annually  is  spent  answering  code  queries  and  not  reviewing  plans. 

Effect: 

1 . Contradictory  responses  to  the  same  code  question  contributes  to 
customer  confusion  and  impatience.  Plans  submitted  in 
accordance  with  one  code  interpretation  may  be  rejected  because 
of  a conflicting  interpretation  of  the  code  used  by  the  actual  plan 
reviewer. 

2.  Responding  to  code  inquiries  detracts  from  plan  review  duties. 
Interruptions  can  derail  the  train  of  thought  and  cause  delays  far 
beyond  the  actual  time  spent  responding  to  the  inquiry. 


Executive  Summary  - 1 - 8 


City  and  County  of  San  Francisco  Department  of  Building  Inspection 
Performance  Audit 


Introduction 

In  November  1994,  the  voters  of  the  City  and  County  of  San  Francisco  passed 
Proposition  G removing  the  Bureau  of  Building  Inspection  from  the  Department  of 
Public  Works  and  establishing  it  as  a separate  City  department.  The  Department  of 
Building  Inspection  (DBI)  is  responsible  for  a wide  variety  of  services,  including  the 
inspection  of  buildings  and  structures  for  compliance  with  related  codes  and  regulations; 
reviewing  plans  for  conformance  with  related  codes  and  regulations;  approving  and 
issuing  permits,  updating  microfilm  records,  and  processing  Residential  Records  reports. 

The  services  provided  by  the  Department  are  funded  entirely  from  fee  revenues  relating 
to  plan  checking,  permitting  and  licensing. 

To  support  these  important  services,  the  Department  also  provides  administrative  support 
and  general  management  activities  such  as  financial  planning,  budgeting,  purchasing, 
accounting,  human  resources  management,  and  customer  services.  Both  these  services 
and  activities  combine  to  create  a complex  and  sophisticated  organization. 

The  CCSF  DBI  faces  a unique  set  of  challenges  in  the  execution  of  its  mission. 

Geographical  challenges  in  San  Francisco  include  an  expansive  waterfront,  wide 
differences  in  elevation,  and  significant  seismographic  concerns.  These  natural  factors, 
combined  with  man-made  features  such  as  varied  residential  and  commercial 
construction  as  well  as  the  rebounding  high  rise  construction  industry,  would  seem  to  be 
enough  of  a challenge.  In  addition  to  both  these  conditions  the  Department  must  satisfy  a 
very  active  and  vocal  political  electorate,  making  the  efficiency  and  effectiveness  of  this 
public  entity  a paramount  public  concern. 

Performance  Audit  Objectives  and  Scope 

On  May  3,  1999  KPMG  LLP  (KPMG)  was  engaged  by  the  City  Controller’s  office  to 
conduct  a performance  audit  of  the  CCSF  DBI.  The  objectives  and  the  audit  scope  set 
the  context  for  this  effort.  The  audit  team  was  charged  to  conduct  a performance  audit  to 
highlight  operational  or  efficiency  issues  within  the  DBI.  Specifically,  the  City  and  the 
Commission  members  were  interested  in  determining  the  level  of  efficiency  and 
effectiveness  in  which  housing  inspections  are  conducted  and  building  permits  are 
processed  by  the  Department.  Given  the  nature  of  the  services  to  be  provided,  KPMG 
recommended  and  employed  a two-phased  approach  for  the  conduct  of  this  performance 
audit  consisting  of  a management  level  risk  assessment  followed  by  a narrowly  defined 
detailed  audit 

Approach  and  Methodology 

KPMG  employed  a two-phased  approach  for  the  conduct  of  this  performance  audit.  Phase  One 
of  the  project  consisted  of  a department-wide  risk  assessment.  During  this  initial  phase.  KPMG 
sought  to  develop  a broad  understanding  of  the  practices  currently  employed  by  the  DBI.  Using 
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techniques  such  as  focus  interviews  and  an  internal  document  review,  KPMG  was  able  to 
identify  general  areas  of  higher  risk.  Following  the  classification  of  high,  medium,  and  low  risk 
areas,  we  developed  an  audit  plan  consisting  of  four  evaluation  techniques  to  effectively  analyze 
the  high  risk  areas  and  also  a number  of  medium  and  lower  risk  areas  as  well.  Our  audit  used  the 
analytical  techniques  or  methodologies  listed  below: 


■ Structured  Interviews  with  Key  Management  and  Staff.  KPMG  conducted  over 
30  interviews  with  management  and  staff  most  familiar  with  the  overall  departmental 
operations  as  well  as  the  specific  operating  practices,  job  responsibilities  and 
organizational  climate  in  each  area.  KPMG  interviewed  DBI  employees  in  a variety 
of  functional  areas  and  management  levels  within  the  DBI.  These  interviews 
permitted  not  only  a “top-down”  view  of  internal  operations  and  practices,  but  also  a 
bottom-up  and  lateral  perspective  as  well. 

■ Review  of  Relevant  Documentation.  The  team  reviewed  hundreds  of  pages  of 
numerous  Department  documents  addressing  performance  data,  standard  operating 
procedures,  customer  outreach  programs,  prior  audits,  general  and  specific 
departmental  policies,  and  governing  regulations. 

■ Business  Process  Analysis.  In  the  conduct  of  this  task  we  evaluated  the  current  state 
of  the  operational  practices  and  systems  in  the  DBI.  KPMG  developed  “as  is” 
process  maps,  physically  examined  the  activities  performed  in  the  divisions  via 
operational  walkthroughs  and  inspector  “ride-alongs,”  refined  our  initial  findings  via 
the  use  of  focus  groups  and  follow-on  focus  interviews,  and  identified  specific 
problem/weakness  areas  requiring  the  DBI  leadership’s  attention. 

■ Organizational  Analysis.  The  team  conducted  an  extensive  span  of  control  analysis 
of  the  DBFs  administrative  and  operational  functional  areas  to  help  us  evaluate  the 
efficiency  and  effectiveness  of  current  operations.  This  effort  examined  current  ratios 
of  managers  to  supervisors  across  the  entire  DBI  as  well  as  high-risk  areas,  and  layers 
of  management.  We  also  analyzed  the  employee  utilization  practices  of  the  DBI  and 
evaluated  the  effectiveness  of  the  Department's  training  program.  Both  efforts  were 
supported  by  two  confidential  surveys  developed  and  distributed  by  the  KPMG  audit 
team. 

■ Benchmarking  Survey.  KPMG’ s audit  team  conducted  surveys  of  comparative 
candidates  both  within  and  outside  of  the  State  of  California  soliciting  information  on 
key  performance  indicators  of  the  Department.  KPMG  worked  closely  with  members 
of  the  DBI  leadership  to  select  these  peer  candidates  and  indicators  to  ensure  the 
viability  of  the  resulting  benchmarking  analysis  and  the  identification  of  meaningful 
comparisons. 

■ Performance  Measurement  Study.  Performance  measurement  is  not  simply 
concerned  with  collecting  data.  It  is  better  thought  of  as  an  overall  management 
system  with  the  goal  of  increasing  the  efficiency  and  effectiveness  of  the  process  or 
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the  product.  Performance  measurement  actions  operate  in  a continuous  cycle 
allowing  options  for  expansion  and  improvement  of  the  work  process  or  product  as 
better  techniques  are  discovered  and  implemented.  KPMG  conducted  a 
comprehensive  review  of  the  Department’s  current  performance  measurement 
program  reviewing  data  collection  and  analysis  protocols  along  with  sample  sets  of 
performance  data. 

■ Focused  Expenditure  Review.  At  the  special  direction  of  the  City  Controller’s 
Office  KPMG  conducted  a limited  audit  of  the  Department’s  expenditures  for  the 
purchase  of  laptop  computers.  KPMG  examined  authorization  documentation; 
relevant  purchase  orders  and  conducted  a sample  serial  number  inventory  of  this 
equipment. 

Constraints  and  Limitations 

Constraints  and  Limitations  present  special  factors  that  should  be  considered  in  the 
interpretation  of  the  audit  results.  Key  factors  to  consider  include: 

■ In  the  execution  of  the  performance  audit  the  audit  team  followed  generally  accepted 
government  audit  standards  as  set  forth  in  the  General  Accounting  Office’s 
Government  Auditing  Standards  “Yellow  Book”. 

■ The  audit  was  not  intended  to  be  a comprehensive  review  of  all  program  and 
functions  in  the  Department.  The  Phase  One  Risk  Assessment  identified  several 
high-risk  areas  within  the  Department  that  we  used  to  focus  our  audit  team’s  efforts 
during  Phase  Two.  Several  functional  areas  where  noticeable  risk  was  identified 
were  not  addressed  due  to  time  and  budgetary  constraints. 

■ The  audit  team  observed  DBI  operations,  accompanied  Department  personnel  in  the 
conduct  of  their  field  inspection  activities;  reviewed  extensive  amounts  of  data, 
records  and  documents  provided  by  the  DBI  staff.  It  was  not  within  the  scope  of  this 
effort  to  validate  secondary  sources  of  information. 

The  audit  team  was  not  afforded  the  opportunity  to  interview  the  members  of  the 
Building  Inspection  Commission  for  their  input  to  this  audit.  KPMG  did  receive  written 
input  from  one  BIC  commissioner  that  we  incorporated  into  the  scope  of  this  audit  to  an 
extent  consistent  with  the  results  of  our  Phase  One  risk  Assessment. 

Report  Organization 

KPMG  organized  the  City  and  County  Department  of  Building  Inspection  Performance 
Audit  Report  into  the  following: 

■ Executive  Summary:  outlines  the  major  report  recommendations  addressing  areas  to 
sustain  and  opportunities  for  improvement 
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■ Introduction  - describes  the  audit  scope,  approach,  and  methodology  used  to 
conduct  fieldwork  activities  as  well  as  limitations  and  constraints  pertinent  to 
interpretations  of  the  audit  findings. 

■ Business  Process  Analysis  - contains  an  overview  of  our  BPA  approach;  detailed 
observations,  analysis,  findings  and  recommendations  in  the  functional  operations  of 
the  Inspection  and  Plan  Check  Divisions. 

■ Organizational  Analysis-  contains  an  overview  of  our  Organizational  Analysis 
approach;  detailed  observations,  analysis,  findings  and  recommendations  on  the 
organizational  structure  and  training  program  of  the  Department  of  Building 
Inspection. 

■ Benchmarking  Study-  contains  an  overview  of  our  Benchmarking  approach, 
detailed  analysis  and  findings  resulting  from  our  peer  comparison  of  performance 
indicators  from  the  Inspection  and  Plan  Check  Divisions  and  recommendations  for 
improving  operations  in  these  areas. 

■ Performance  Measurement  Study  - contains  an  overview  of  our  approach  to 
studying  performance  measures,  detailed  observations  and  analysis,  and  findings 
from  our  review  of  the  DBFs  data  collection  methods  and  analysis  of  performance 
information  from  the  Inspection  and  Plan  Check  Divisions.  We  also  offer 
recommendations  for  improving  operations  in  these  areas. 

■ Focused  Expenditure  Review  - contains  an  overview  of  our  audit  approach;  detailed 
observations  analysis  and  findings  from  our  efforts  to  determine  the  disposition  of 
the  DBFs  laptop  computers. 

■ Appendices  - presents  additional  information  references  in  the  body  of  the  report 
such  as  Phase  One  Risk  Assessment,  benchmarking  survey  responses,  etc. 
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BUSINESS  PROCESS  ANALYSIS 

Introduction 

Business  processes  are  a key  element  in  any  organization’s  operations.  As  part  of  our 
performance  audit,  KPMG  examined  the  DBFs  core  business  processes  to  understand, 
evaluate,  and  identify  opportunities  for  improvement  in  each  of  them.  KPMG  utilized  the 
results  of  its  Phase  One  risk  assessment  to  identify  the  following  four  core  processes: 

■ Inspection  Operations  (Electrical,  Plumbing,  Building,  Housing) 

■ Plan  Check  Operations  (Mechanical,  Major  Project,  Commercial,  Residential) 

■ Central  Permit  Bureau  permit  issuance 

■ One-Stop  permit  issuance 

In  this  section  of  the  report,  we  discuss  each  of  these  core  business  processes  in  the 
content  outlined  below: 

■ Overview 

■ Approach  and  Activities 

■ Findings  and  Analysis 

■ Recommendations 


Inspections 

Overview 

The  Department  of  Building  Inspection  performs  approximately  127,000  inspections  on 
an  annual  basis,  maintaining  specialty  inspectors  in  four  different  inspection  divisions  as 
listed  below: 

■ Plumbing 

■ Electrical 

■ Building 

■ Housing 

Process  Beginning  and  End  Points 

The  inspection  process  can  be  initiated  in  two  ways.  Both  involve  action  by  Department 
‘customers,’  either  those  holding  permits  for  construction  or  those  suspecting  City  codes 
are  being  violated. 

■ Permit-holders  initiate  the  inspection  process  by  requesting  an  inspection  of 
ongoing  construction  by  Building,  Plumbing  or  Electrical  inspectors,  as  a step 
in  securing  the  final  approval  of  a permit  upon  completion. 

■ Those  suspecting  code  violations  initiate  the  inspection  process  by  filing  a 
complaint,  usually  by  telephone,  and  identifying  the  suspected  property  for 
investigation  by  the  Department’s  Housing  Inspectors. 


Business  Process  Analysis  - / - 1 


City  and  County  of  San  Francisco  Department  of  Building  Inspection 
Performance  Audit 


The  inspection  process  ends  when  either: 

■ An  inspector  issues  the  final  approval  of  a construction  permit,  after  all  the 
required  inspections  of  the  construction  project  are  successfully  completed;  or 

■ A Housing  inspector  certifies  that  the  suspected  structure  is  in  compliance 
with  health  and  safety  codes. 

Key  Tasks  and  Responsibilities 

Key  tasks  and  participants  in  the  process  are  as  follows: 

■ Clerical  staff  establish  an  appointment  for  the  inspection  of  construction 
underway  or  the  investigation  the  validity  of  a complaint; 

■ Inspectors  collect  all  background  information  on  the  inspection  or  complaint; 

■ Inspectors  performing  the  inspection(s),  and 

■ Inspectors  document  results  of  the  inspection(s)  on  specialized  forms  and 
logs. 

Automation 

The  use  of  automation  varies  among  inspection  divisions. 

■ Housing  and  Building  divisions  use  the  Oracle  2000  system  to  generate 
inspection  appointment  schedules,  research  background  information,  and 
document  inspection  results. 

■ Electrical  and  Plumbing  divisions  use  a combination  of  manual  processes  and 
the  legacy  Oracle  system  to  perform  these  tasks. 

Process  Times  and  Benchmarks 

Times  for  inspections  vary  considerably  depending  on  the  complexity  of  the  inspection  as 
well  as  transportation  and  parking  difficulties.  Each  separate  division  maintains 
inspections  per  inspector  per  day  targets  to  measure  performance.  These  are  discussed  in 
detail  in  the  section  on  performance  measures. 


Process  flow  diagrams  for  the  Building , Plumbing/Electrical  and  Housing  Inspection 
divisions  follow  on  pages  3 -12  . 
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San  Francisco  Department  of  Building  Inspection 
Building  Inspection  Services  Process  Flow 
Figure  I - 1A 
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San  Francisco  Department  of  Building  Inspection 
Building  Inspection  Services  Process  Flow 
Figure  l - 1 B 
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San  Francisco  Department  of  Building  Inspection 
Building  Inspection  Services  Process  Flow 
Figure  I -1C 
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San  Francisco  Department  of  Building  Inspection 
Building  Division  Complaints  Process  Flow 
Figure  I - ID 
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San  Francisco  Department  of  Building  Inspection 
Building  Division  Complaints  Process  Flow 
Figure  I - IE 
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San  Francisco  Department  of  Building  Inspection 
Plumbing/Electrical  Inspection  Division  Process  Flow 
Figure  I - 2A 
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San  Francisco  Department  of  Building  Inspection 
Plumbing/Electrical  Inspection  Division  Process  Flow 
Figure  I - 2B 
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San  Francisco  Department  of  Building  Inspection 
Plumbing/Electrical  Inspection  Division  Process  Flow 
Figure  I - 20 
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San  Francisco  Department  of  Building  Inspection 
Plumbing/Electrical  Inspection  Division  Process  Flow 
Figure  I - 2D 
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San  Francisco  Department  of  Building  Inspection 
Plumbing/Electrical  Inspection  Division  Process  Flow 
Figure  I - 2E 
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Approach  and  Activities 

To  examine  the  inspection  process  and  associated  activities  KPMG  utilized: 

■ Process  flow  diagrams  mapping  “as  is”  processes  to  identify: 

■ Weaknesses  in  internal  controls 

■ Manual  vs.  automated  interfaces 

■ Inefficiencies  in  the  process  workflow 

■ Focus  groups  to  confirm  our  understanding  of  the  process  and  correct  process 
maps 

■ Background  data  reviews  including  operating  procedures  manuals  and  forms 
to  obtain  a further  understanding  of  the  organization 

■ Operational  walk-throughs  and  “ride-alongs”  with  inspectors  for  the  purpose 
of  assessing  compliance  with  standard  operating  procedures 

■ Interviews  with  division  managers,  senior  inspectors  and  inspectors  to  gain  an 
understanding  of  activities  performed 

■ Additional  test  work  and  sample  analysis  performed  in  our  subsequent 
September  2000  review 


Findings  and  Analysis 

As  a result  of  our  activities  and  based  on  our  analysis  of  the  information  gathered,  KPMG 
identified  the  following  opportunities  for  improvement: 

■ Information  Systems  and  Automation 

■ Policies  and  Procedures 

■ Additional  Observations 

Each  of  these  opportunities  are  discussed  below. 

Information  Systems  and  Automation 
Finding 

1-1.  The  Department’s  existing  inspection  records  processes  are  paper  driven  and 
manually  intensive. 

Analysis 

Currently,  the  necessity  to  manually  log  information  onto  a series  of  forms  delays  the 
process  for  conducting  an  inspection  and  reporting  the  results.  KPMG  observed  the 
inspection  process  in  detail  during  a “ride-along”  with  a Department  inspector.  The 
inspector: 

■ Arrived  at  the  site  and  requested  the  site  card  from  the  contractor  or  property  owner; 
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■ Performed  walk-throughs  of  plan  check  operations 

■ Conducted  interviews  with  plan  check  managers  and  plan  checkers 

■ Additional  test  work  and  sample  analysis  performed  in  our  subsequent 
September  2000  review 


Process  flow  diagrams  for  the  Plan  Check  divisions  follow  on  pages  1-19  - 1-20 . 
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San  Francisco  Department  of  Building  Inspection 
Plan  Check  Process  Flow 
Figure  I - 4A 
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San  Francisco  Department  of  Building  Inspection 
Plan  Check  Process  Flow 
Figure  I - 4B 
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Findings  and  Analysis 

The  plan  check  division’s  strengths  result  from  the  specialization  of  plan  check  reviews 
into  four  plan  check  categories: 

■ Residential 

■ Commercial 

■ Major 

■ Mechanical 

Due  to  the  different  levels  of  resources  required  for  each  plan  type,  separate  divisions 
were  created  to  allow  plan  review  staff  to  specialize  and  expedite  the  plan  review 
process.  The  divisional  specialization  is  intended  to  shorten  plan  turnaround  time 
through  individual  specialization  at  one  type  of  plan  review. 

“Over  the  Counter”  Plans 

Finding 

1-4.  A number  significant  number  of  plans  taken  in  for  “behind-the-counter”  reviews 
take  less  than  30  minutes  and  may  potentially  be  reviewed  “over-the-counter” 

Analysis 

Currently,  counter  clerks  are  able  to  ‘review’  many  simple  plans  over  the  counter,  and 
plan  check  professionals  staffing  the  counter  can  review  additional  plans  of  limited 
complexity.  Additional  plans  requiring  ‘behind  the  counter’  reviews  by  engineers  are 
accepted  for  review  and  must  wait  in  ‘backlog’  status  until  reviewed  by  plan  check  staff. 
KPMG’s  June  1999  review  estimated  this  backlog  at  two  to  four  weeks.  (Backlog  times 
could  not  be  estimated  for  our  subsequent  review  in  September  2000  due  to  ongoing  data 
classification  issues  resulting  from  the  migration  to  the  Oracle  2000  system.) 

By  reviewing  additional  plans  over  the  counter,  the  Department  can  minimize  the  number 
of  plans  for  which  approval  is  delayed  due  to  the  backlog  period.  We  examined  plan 
reviews  performed  over  two  separate  two- week  periods  in  July  and  August  2000  to 
determine  the  proportion  of  ‘behind  the  counter’  reviews  with  comparatively  brief  actual 
review  times.  Our  analysis  determined  that  actual  reviews  of  a significant  minority  of 
plans  took  30  minutes  or  less,  as  summarized  in  the  table  below. 


Table  1-2  - Average  Actual  Review  Times 


Period  Examined 

Actual  Review  Time 

% of  Total  Reviews  Performed  in  Period 

July  1 - 15,  2000 

30  minutes  or  less 

20%  or  (151  of  776) 

15  minutes  or  less 

3%  or  (25  of  776) 

August  1 - 15,  2000 

30  minutes  or  less 

19%  or  (160  of  847) 

15  minutes  or  less 

3%  or  (27  of  847) 
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Many  but  not  all  reviews  under  30  minutes,  e.g.  mechanical  reviews  or  repeated 
structural  reviews  of  the  same  plan  set,  may  be  candidates  for  over  the  counter  reviews  by 
plan  review  professionals  staffing  the  counter. 

Process  Workflow 


Finding 

1-5.  The  use  of  inspectors  to  perform  an  initial  first  review  of  plans  followed  by 
secondary  reviews  by  engineers  does  not  appear  to  be  efficient  nor  cost-effective. 

Analysis 

Current  plan  check  processes  call  for  plan  checking  staff  with  a building  inspector 
classification  to  review  certain,  less  technical,  aspects  of  plans  while  leaving  more 
complex  structural  and  architectural  issues  to  staff  with  an  engineering  classification. 
This  division  of  labor  is  designed  to  allow  more  highly-paid  and  trained  engineers  to 
focus  their  time  on  tasks  requiring  their  specialized  expertise.  In  practice,  the  gains  in 
efficiency  and  cost  savings  of  this  practice  are  unclear.  However,  the  extent  of  this 
condition  could  not  be  estimated  by  a review  of  associated  documentation.  Specifically, 
focus  group  feedback  indicated  that: 

■ The  potential  exists  for  building  inspectors  with  plan  check  duties  to  miss 
potential  code  issues  due  to  their  limited  expertise.  These  issues  are  subsequently 
identified  by  engineers  with  plan  check  duties  during  their  second  stage  check. 

■ Building  inspector  staff  may  take  longer  to  review  the  less  technical  elements  of 
the  plan  than  the  time  needed  by  engineers  to  review  these  same  elements. 


Additionally,  building  inspectors  are  eligible  for  overtime  pay  while  engineers  are  not.  A 
brief  overview  of  the  inspector  and  engineer  roles  in  the  process  is  diagrammed  below. 


CPB  routes  the  plan  application  to  the  plan  check  division 
for  review.  Inspectors  review  portions  of  the  plans. 


Plans  are  re-routed 
back  to  the 
inspector  for 
revision. 


Inspectors  submit  the  plans  to  engineers  and 
the  engineer  reviews  the  inspector’s  work 
noting  any  comments  meriting  revision 


Figure  I - 5 - Inspector  and  Engineer  Roles  in  DBI  Plan  Review 

While  current  engineering  positions  in  the  plan  check  divisions  are  primarily  filled  by 
civil  engineers,  associate  civil  engineers  (with  a lower  pay  scale)  may  prove  to  be  more 
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effective  as  plan  review  staff  than  building  inspectors.  In  addition,  salary  levels  paid  to 
building  inspectors  and  associate  engineers  appear  to  be  similar. 


Table  1-3  - Comparison  of  Associate  Engineer  and  Building  Inspector  Salary  Scales 


Job  Classification 

Entry  Salary 

Salary  Ceiling 

Associate  Civil  Engineer 

$56,976 

$69,269 

Building  Inspector 

$59,691 

$72,532 

It  should  be  noted  that  union  objections  may  be  raised  to  any  elimination  of  the  building 
inspectors’  role  in  the  plan  review  process.  Official  job  descriptions  for  the  building 
inspector  positions  include  plan  review  duties. 

Finding 

1-6.  Quality  Control  check  records  can  provide  useful  information  on  potential 
changes  for  increased  efficiency  in  the  plan  review  process. 

Analysis 

Currently,  all  approved  plans  are  routed  to  the  One-Stop  division  for  a quality  control 
review  for  completeness  including  appropriate  approvals,  occupancy  numbers,  building 
codes  and  fee  stamps.  Plans  ‘passing’  the  quality  control  check  are  then  forwarded  to  the 
Central  Permit  Bureau  and  again  reviewed  by  the  CPB  staff.  A review  of  Quality  Control 
check  documentation  for  20  permit  applications  resulted  in  the  following  observations: 

• In  20%  of  the  applications  reviewed,  the  Quality  Control  check  identified  plans 
that  either  had  not  been  routed  through  Mechanical  Plan  Check  as  required  or 
were  missing  approvals  or  signatures  from  their  reviewers. 

• In  15%  of  the  applications  reviewed,  the  Quality  Control  Check  identified  plans 
that  had  outstanding  complaints  requiring  Housing  Inspection  review. 

Of  the  4 plans  returned  to  Mechanical  Plan  Check,  one  required  an  additional  19  calendar 
days  before  the  completion  of  the  review  process. 

Recommendations 

1-3.  The  Department  should  examine  the  potential  for  increasing  the  presence  of 
engineering  staff  on  plan  check  counters  and  modifying  current  application  screening 
procedures  to  maximize  the  number  of  “over  the  counter” plan  check  approvals. 

By  increasing  the  volume  of  “over  the  counter”  approvals,  the  Department  can  limit  the 
number  of  plans  taken  in  for  ‘behind  the  counter’  review  and  reduce  plan  check  backlogs. 
To  determine  the  benefits  of  an  increased  engineering  staff  presence  at  plan  check 
counters,  the  following  approaches  should  be  examined: 


KPMQ 
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■ From  a sample  of  all  plans  accepted  for  behind  the  counter  review,  determine  what 
percentage  could  be  checked  OTC  by  plan  check  engineers,  and  the  time  required  for 
doing  so. 

■ By  observation  on  random  days,  determine  what  percentage  of  plan  check  engineer 
time  is  spent  actually  performing  OTC  reviews  as  opposed  to  ancillary  activities  such 
as  responding  to  general  code  questions.  An  OTC  review  may  require  additional  time 
(as  compared  to  a “behind  the  counter”  review)  because  of  the  need  for  customer 

interaction. 

Any  change  in  plan  check  staffing  patterns  should  be  implemented  only  after  studying  the 
overall  impact  on  plan  check  service  levels  for  both  OTC  and  “behind  the  counter”  plans. 

1-4.  Examine  the  potential  for  utilizing  engineering  staff  in  place  of  current  building 
inspector  staff  for  plan  check  duties  if  union  concerns  can  be  addressed  and  additional 
personnel  expenses  are  minimal 

Current  plan  check  procedures  call  for  plan  checking  staff  with  a building  inspector 
classification  to  review  specific,  less  technical  aspects  of  plans  while  leaving  more 
complex  structural  and  architectural  issues  to  staff  with  an  engineering  classification. 
However,  in  practice,  the  efficiency  gains  and  cost  savings  of  this  practice  are  unclear. 

Any  change  in  plan  check  staffing  patterns  should  be  implemented  only  after  determining 
if  efficiency  gains  from  utilization  of  engineer  plan  check  staff  outweigh  the  projected 
additional  compensation  costs.  Union  concerns  may  also  need  to  be  addressed. 

1-5.  Conduct  periodic  reviews  of  Quality  Control  records  to  identify  potential 
improvements  in  the  plan  review  process  and  take  steps  to  implement  these. 

Our  review  of  Quality  Control  records,  for  example,  identified  two  problem  areas  which 
the  Department  can  take  steps  to  minimize. 

• Review  by  the  Mechanical  Plan  Check  section  is  frequently  missed  or  lacks 
formal  approval  signatures  (in  4 of  20  records  examined).  Greater  care  in  the 
original  routing  of  plans  by  reviewers  or  clerical  staff  using  the  bin  system,  and 
attention  to  procedural  requirements  by  Mechanical  Plan  Check  staff  may  assist  in 
minimizing  this  problem. 

• Applications  with  outstanding  complaints  are  accepted  into  the  review  process 
without  Housing  Inspection  clearance  (in  3 of  20  records  examined).  Steps  to 
ensure  an  initial  check  of  complaint  records  before  accepting  plans  into  the  review 
process  could  help  minimize  this  problem. 


Process  flow  diagrams  for  the  Central  Permit  Bureau  follow  on  pages  1-25  to  1-29 . 
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San  Francisco  Department  of  Building  Inspection 
Central  Permit  Bureau  Process  Flow 
Figure  I - 6A 
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San  Francisco  Department  of  Building  Inspection 
Central  Permit  Bureau  Process  Flow 
Figure  I - 6B 


Customer 


Central  Permit 
Bureau 


Divisions 


ME 


Business  Process  Analysis  -1-26 


City  and  County  of  San  Francisco  Department  of  Building  Inspection 
Performance  Audit 


San  Francisco  Department  of  Building  Inspection 
Central  Permit  Bureau  Process  Flow 
Figure  I - 6C 
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San  Francisco  Department  of  Building  Inspection 
Central  Permit  Bureau  Process  Flow 
Figure  I - 6D 

Customer  Central  Permit  Divisions 
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San  Francisco  Department  of  Building  Inspection 
Central  Permit  Bureau  Process  Flow 
Figure  I - 6E 
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Central  Permit  Bureau 

Overview 

The  Central  Permit  Bureau  (CPB)  is  the  main  permit  issuing  body  of  the  Department  of 
Building  Inspection.  Over  the  past  year,  the  CPB  issued  over  53,000  permits. 

Process  Beginning  and  End  Points 

The  permitting  process  begins  when  plans  with  plan  review  approvals  are  received  by  the 
Central  Permit  Bureau.  Clerks  then  begin  the  fee  assessment  and  issuance  process.  The 
process  ends  when  the  customer  pays  for  and  collects  the  completed  permit. 

Key  Tasks  and  Responsibilities 

Permit  clerks  are  the  key  participants  in  the  process.  They  perform  the  following  key 
tasks: 


■ Collecting  all  reviewed  plans; 

■ Cross-checking  for  prior  notices  of  violation; 

■ Assessing  and  collecting  fees; 

■ Verifying  final  engineer  approvals,  and 

■ Ensuring  that  application  packages  are  complete  for  permit  issuance. 

■ Additional  test  work  and  sample  analysis  performed  in  our  subsequent 
September  2000  review 

Automation 

Central  Permit  Bureau  clerks  rely  on  both  the  Oracle  2000  system  throughout  the  process 
to  research  current  and  related  permit  activity,  calculate  fees  and  input  final  issuance 
information.  However,  many  sub-tasks  are  performed  manually  including  some  fee 
computation  and  the  creation  of  job  cards  for  inspectors. 

Process  Times  and  Benchmarks 

Process  times  for  permit  issuance  vary  widely  and  depend  to  a great  extent  on  drivers 
external  to  the  process.  These  include  completeness  and  accuracy  of  plan  review 
approvals,  delays  caused  by  unpaid  fees  by  the  applicant,  and  the  requirements  to  obtain 
workman’s  compensation  information. 

Approach  and  Activities 

In  our  analysis  of  the  CPB  and  its  activities  KPMG  utilized: 

■ Visio  software  for  mapping  the  “as  is”  processes  to  identify: 

■ Manual  interfaces  in  the  intake  of  applications  and  receipt  from  the 
plan  checkers; 

■ Role  of  the  Oracle  system; 

■ Identification  of  various  manual  forms,  and 

■ Inefficiencies  in  the  process; 
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■ Focus  groups  to  confirm  our  understanding  of  the  process  and  correct  process 
maps; 

■ Background  data  including  operating  procedure  manuals  and  forms  to  obtain 
further  understanding  of  the  organization; 

■ Operational  walk-throughs  of  CPB  operations  for  the  purpose  of  identifying 
standard  operating  procedures,  and 

■ Interviews  with  CPB  managers  and  staff. 

■ Additional  test  work  and  sample  analysis  performed  in  our  subsequent 
September  2000  review 

Based  on  the  data  obtained,  KPMG  noted  that  the  Department  has  an  opportunity  to 
increase  its  operational  efficiency  in  the  following  areas: 

■ Process  Workflow 

■ Information  Systems  and  Automation 

■ Customer  Service 


Findings  and  Analysis 

Information  Systems  and  Automation 

Finding 

1-7.  The  implementation  of  automated  job  card  production  using  the  new  Oracle  2000 
system  has  eliminated  time-consuming  manual  transfers  of  data. 

Analysis 

Inspectors  carry  a job  card  with  site  details  to  their  initial  inspection.  The 
implementation  of  the  new  Oracle  2000  system  has  automated  the  previously  manual 
process  of  producing  these  cards. 

KPMG’s  review  conducted  in  June  of  1999  revealed  that  approximately  10  minutes  was 
required  by  CPB  staff  to  manually  transfer  on-screen  data  from  the  former  Motorola 
system  to  each  job  card.  Based  on  the  53,000  permits  issued  annually,  approximately 
8,800  hours  or  1 100  work  days  were  previously  utilized  for  manually  transferring  job 
card  data.  This  time-consuming  process  has  been  eliminated  with  the  introduction  of  the 
Oracle  2000  system. 

Finding 

1-8.  The  Central  Permit  Bureau  clerical  staff  are  generally  highly  accurate  in  their 
assessment  and  collection  of  Department  fees. 

Analysis 

Our  review  of  a sample  of  25  plumbing,  electrical,  building  and  plan  check  fee 
assessment  receipts  yielded  2 instances  of  inaccurate  fee  assessment.  Each  error 
accounted  for  a negligible  amount  (1/10%)  of  the  total  amount  in  the  sample.  The  table 
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below  summarizes  the  fee  assessment  errors  found,  their  proportion  in  the  sample,  as  well 
as  the  minimal  loss  in  Department  revenues  that  would  result  on  an  annual  basis. 


Table  1-4  — Fee  Assessments 


Assessment  Error 

Amount 

Total  Fees  in  Sample 

Error  as  % of  Total  Fees 

No  permit  issuance  fee 
charged 

(Plumbing,  Mechanical 
Fee  Receipt  #400253) 

$16.55 

$13,484.00 

0.12% 

Excessive  permit  issuance 
fee  charged 

(Plumbing,  Mechanical 
Fee  Receipt  #400278) 

$17.05 

$13,484.00 

0.13% 

Estimated  Annual  Loss  in  Department  Revenues: 

Assessment  Error  @ 0.12%  x FY  1998-1999  Fee  Revenues  @ $30,239,935  = $37,116 


Customer  Service 
Finding 

1-9.  Central  Permit  Bureau  staff  must  frequently  respond  to  calls  and  customers 
incorrectly  directed  to  their  division  resulting  in  operational  interruptions. 

Analysis 

Based  on  information  gathered  from  operational  walk-throughs  and  focus  interviews, 
KPMG  learned  the  following: 

■ The  majority  of  phone  calls  received  are  for  inquiries  unrelated  to  the  CPB 
function.  Most  calls  received  must  be  routed  elsewhere. 

■ Staff  stated  that  at  least  once  a day,  customers  arrive  at  the  CPB  counter  to 
pick  up  their  permits  having  been  incorrectly  informed  that  their  permit  is 
complete. 

■ CPB  staff  indicated  that  many  of  applicants  are  unaware  they  must  pay  a 
permit  fee  in  addition  to  the  plan  check  fee  upon  issuance  of  their  permit  and 
often  do  not  have  sufficient  funds  on  hand.  This  results  in  a return  trip  by  the 
customer. 

These  factors  all  contribute  to  decreased  customer  satisfaction  and  damage  the  perceived 
credibility  of  the  department. 
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1-6.  To  minimize  the  amount  of  time  spent  answering  phone  calls  by  CPB  staff,  the 
Department  should  consider  the  implementation  of  an  Interactive  Voice  Response 
(IVR)  system. 

An  IVR  would  reduce  the  resources  needed  to  answer  phones  and  provide  the  customer 
easier  access  to  the  information  requested  (refer  to  the  section  on  Organizational 
Analysis,  Employee  Utilization). 

One-Stop  Parallel  Permit  Process 

Overview 

The  One  Stop  Permit  program  is  designed  to  allow  the  parallel  processing  of  plans 
requiring  review  by  several  city  departments  rather  than  the  normal  serial  process, 
shortening  the  overall  permit  processing  time.  Applicants  submit  plans  to  permit 
coordinators  who  expedite  simultaneous  processing  by  the  DBI  and  other  city 
departments,  as  briefly  illustrated  in  Figure  1-7  below: 


Permit  coordinators  collect 
the  plans  and  route  them  to 
the  appropriate  divisions 
and  departments 
simultaneously. 


After  plans  are  reviewed  by 
the  divisions,  they  are 
returned  to  the  permit 
coordinator  for  permit 
issuance. 


Figure  1-7  One  Stop  Permit  Coordination 

Process  Beginning  and  End  Points 

The  One  Stop  process  begins  with  the  assignment  of  a permit  coordinator  to  an  applicant. 
Together,  the  customer  and  permit  coordinator  review  the  completeness  of  materials  in 
the  customer’s  application  package.  One  Stop  processing  requires  that  the  customer 
submit  at  least  four  copies  of  plans.  The  process  ends  when  the  One  Stop  division  refers 
the  approved  plans  to  the  Central  Permit  Bureau  for  final  permit  issuance. 
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Key  Tasks  and  Responsibilities 

Key  tasks  and  participants  in  the  process  are: 

■ Permit  Coordinators  conduct  an  initial  consultation  with  the  permit  applicant 
reviewing  applications  for  completeness  before  acceptance; 

■ Permit  Clerks  route  plans  to  DBI  and  on-site  or  off-site  plan  review  staff  from 
other  city  departments; 

■ Permit  Coordinators  relay  comments  requiring  plan  revisions  to  permit 
applicants,  and  relay  revisions  back  to  plan  reviewers,  and 

■ Permit  Coordinators  assemble  approved  multiple  plans  from  different  city 
departments  and  transfer  comments  to  one  unified  set  before  forwarding  to 
CPB  for  permit  issuance. 

Automation 

The  One  Stop  division  maintains  paper  files  on  all  One  Stop  permit  applications.  The 
division  also  uses  the  Oracle  2000  system  for  research  on  permit  applications  on  an  as- 
needed  basis. 

Process  Times  and  Benchmarks 

The  KPMG  project  team  was  unable  to  determine  average  plan  check  process  times  due 
to  inaccuracies  in  data  entry  and  limitations  of  reporting  formats.  These  shortcomings  are 
discussed  further  in  Section  III  on  performance  measures. 

Approach  and  Activities 

In  assessing  the  major  risks,  inefficiencies  and  bottlenecks  in  the  One-Stop  process, 
KPMG  utilized  the  following  tools: 

■ Visio  software  for  mapping  the  “as  is”  processes  to  identify: 

■ Activities  of  the  permit  coordinator, 

■ DBI  and  other  department  interaction,  and 

■ Inefficiencies  in  the  process  workflow; 

■ Focus  groups  to  confirm  our  understanding  of  the  process  and  correct  process 
maps; 

■ Background  data  including  operating  procedure  manuals  and  forms  to  obtain 
further  understanding  of  the  organization;  and 

■ Interviews  with  One-Stop  managers  and  staff. 

■ Additional  test  work  and  sample  analysis  performed  in  our  subsequent 
September  2000  review 


Process  flow  diagrams  for  the  One  Stop  Permit  division  follow  on  pages  1-35  to  1-36. 
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San  Francisco  Department  of  Building  Inspection 
One  Stop  Permit  Process  Flow 
Figure  I - 7 A 
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San  Francisco  Department  of  Building  Inspection 
One  Stop  Permit  Process  Flow 
Figure  I - 7B 
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Findings  and  Analysis 

Although  the  division  is  currently  undergoing  changes,  KPMG  has  noted  the  following 
areas  for  improvement. 

■ Permit  coordinator  training 

■ Procedures  for  communicating  changes  to  other  plan  check  divisions 


Finding 

1-10.  Plan  check  staff  lack  full  confidence  in  the  adequacy  of  One  Stop  permit 
coordinator  skills. 

Analysis 

Focus  group  feedback  indicated  the  following  perceptions  of  inadequacies  in  the  One 
Stop  process: 

■ Failure  of  permit  coordinators  to  request  adequate  documentation  during  the 
screening  of  incoming  plans  prior  to  acceptance  and  routing  to  plan  reviewers. 

■ Incomplete  or  inaccurate  transfers  by  permit  coordinators  of  comments  from 
approved  plan  copies  to  final,  unified  plan  sets. 

These  perceived  obstacles  detract  from  the  ability  of  permit  coordinators  to  carry  out 
their  assigned  function  and  create  the  need  for  additional  work  by  some  plan  check  staff. 
However,  our  review  found  insufficient  documentation  to  substantiate  the  perceptions  of 
plan  check  staff  members. 

Finding 

1-11.  The  current  One  Stop  Permit  process  does  not  ensure  the  re-review  of  all  plan 
changes  that  may  effect  code  compliance.  This  condition  could  increase  the  potential 
for  approval  of  non-compliant  construction. 

Analysis 

The  One  Stop  process  was  designed  to  reduce  the  amount  of  time  required  to  review 
plans  requiring  approvals  by  multiple  City  departments  by  routing  copies  of  plans  to  each 
relevant  department  for  ‘parallel’  review.  Plan  reviews  by  multiple  departments  are 
normally  accomplished  sequentially,  with  the  same  set  of  plans  passing  from  one 
department  to  the  next. 

However,  focus  group  comments  from  plan  reviewers  indicate  that  review  changes  by 
one  department  which  may  effect  the  review  approval  of  another  department  have  gone 
overlooked.  For  example,  Health  Department  requirements  for  a change  to  building 
plans  may  result  in  an  adjustment  that  would  not  receive  the  approval  of  the  Fire 
Department.  The  present  process  routes  all  plans  with  changes  made  by  non-DBI  City 
departments  (e.g.  Health,  Fire,  DPW,  etc.)  back  to  DBI  reviewers  for  re-review  to  ensure 
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compliance  with  structural  and  architectural  requirements,  but  does  not  route  such  plans 
for  re-review  by  other  City  departments  such  as  Fire. 

Though  the  One  Stop  permit  coordinator  responsible  for  consolidating  all  plan  copies 
reviews  such  plans,  the  coordinator  may  lack  the  training  to  identify  changes  made  by 
one  City  department  that  may  significantly  impact  plan  approval  from  another.  Focus 
group  comments  indicate  such  ‘mistakes’  may  not  be  identified  until  the  inspection  stage, 
when  an  inspector  familiar  with  code  requirements  views  the  already  completed 
construction  in  question. 


Recommendations 

1-7.  Request  that  plan  review  staff  track  specific  instances  of  inadequacies  in  the 
Permit  Coordination  process  and  consider  providing  additional  training  to  One-Stop 
Coordinators  if  staff  perceptions  are  substantiated. 

We  suggest  that  the  Department  take  steps  to  identify  areas  where  the  permit 
coordinator’s  skills  fail  to  match  demands  and,  if  warranted,  develop  supplemental 
training  to  address  these.  Better  trained  permit  coordinators  are  more  likely  to  win  the 
confidence  of  Plan  Check  division  staff,  and  can  play  a more  valuable  role  in  the  parallel 
plan  check  process. 

1-8.  Ensure  the  re.-review  of  all  plan  changes  that  may  effect  code  compliance  by  other 
City  departments. 

To  reduce  the  potential  for  oversight,  the  Department  should  formalize  a procedure  for 
communicating  plan  changes  in  one  City  department  that  may  impact  plan  approvals  in 
another.  This  could  be  achieved  by  establishing: 

■ Conditions  under  which  department  reviewers  must  communicate  required  revisions 
to  plans  to  other  reviewing  departments;  and 

■ Criteria  for  Permit  Coordinators  for  the  re-routing  of  approved  plan  sets  received 
from  one  City  department  back  to  secure  a second,  priority  review  from  another. 


Business  Process  Analysis  -1-38 


City  and  County  of  San  Francisco  Department  of  Building  Inspection 
Performance  Audit 


BENCHMARKING 

Introduction 

As  part  of  its  performance  audit  of  the  DBI,  KPMG  employed  certain  analytical  tools  to 
assess  the  state  of  current  Department  operations  and  identify  potential  opportunities  for 
improvement.  One  of  the  tools  utilized  was  ‘benchmarking’  through  comparative 
surveys.  An  overview  of  our  benchmarking  methodology  and  the  results  of  our 
benchmarking  analysis  are  discussed  as  outlined  below: 

■ Approach  to  Benchmarking 

■ Selection  of  Functions  Benchmarked 

■ Selection  of  Comparison  Candidates 

■ Data  Collection  Activities 

■ Findings  and  Gap  Analysis 

■ Additional  Observations 

■ Recommendations 


Approach  to  Benchmarking 

Benchmarking  involves  the  collection  and  use  of  information  from  outside  organizations 
to  improve  operations  within  your  own  organization.  Information  gathered  commonly 
includes  performance  measures,  numerical  indicators  of  the  efficiency  and  effectiveness 
of  an  operation;  and  business  practices  - those  processes  and  techniques  employed  to  get 
the  work  done.  Comparative  data  can  assist  organizations  in  identifying  low  performing 
functions  and  potential  changes  to  practices  that  can  improve  performance. 

Successful  benchmarking  is  more  an  art  than  a science  but  should  adhere  to  certain 
principles.  These  include: 

■ Benchmarking  those  functions  most  significant  to  the  organization. 

Significance  can  be  measured  by  indicators  including  the  proportion  of  staff 
involved,  cost  to  the  organization  and  the  impact  of  the  function  on  other 
operations. 

■ Identifying  measures  of  both  efficiency  (cost)  and  effectiveness  (service) 

Efficiency  measures  indicate  how  economically  resources  are  used  to  achieve 
the  organization’s  product,  often  measured  per  unit,  e.g.,  per  dollar  or  per  staff 
member.  Effectiveness  measures  indicate  how  well  the  organization  is 
carrying  out  its  functions,  often  from  the  user  or  customer  perspective. 

■ Selecting  a variety  of  high-performing  organizations  for  comparison 

If  functions  being  benchmarked  are  specific  to  your  industry,  other 
organizations  in  the  same  industry  are  the  most  useful  benchmark  targets.  For 
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more  generalized  functions,  such  as  payroll  or  personnel,  benchmarking 
organizations  in  other  industries  can  yield  valuable  information. 

■ Interpreting  data  in  the  context  of  differing  operational  environments 

No  two  organizations  operate  under  the  same  conditions  and  with  the  same 
management  structures.  When  comparing  performance  levels  across 
organizations,  different  external  operating  environments  rather  than  different 
internal  structures  or  procedures  within  management  control  may  offer 
explanations  for  gaps  in  performance. 

Organizations  sometimes  object  to  benchmarking  because  of  the  danger  of  unfavorable 
comparisons  with  performance  levels  in  other  organizations.  Performance  gaps  per  se  do 
not  necessarily  indicate  opportunities  for  improvement  in  the  organization.  Performance 
gaps  do  indicate  areas  where  explanations  should  be  sought.  Such  explanations  include 
the  occurrence  of  ‘apples  to  oranges’  comparisons,  with  organizations  defining  the 
‘same’  indicator  differently.  Other  explanations  include  the  lack  of  certain  procedures  or 
controls  that  the  organization  could  benefit  from. 

Selection  of  Functions  Benchmarked 

The  Department  of  Building  Inspection  engages  in  numerous  functions  to  achieve  its 
mission  of  safeguarding  life  and  property  through  the  enforcement  of  City  and  County 
building  codes  and  regulations.  Each  function  encompasses  different  business  practices 
and  many  are  evaluated  through  specific  performance  measures.  An  exhaustive 
benchmarking  effort  for  all  these  functions  is  unlikely  to  be  cost-effective.  Rather,  those 
functions  most  central  to  the  organization’s  mission  should  be  considered.  With  this  in 
mind,  three  performance  measures  for  the  following  two  DBI  functions  were  selected 
(Table  II- 1)  with  the  concurrence  of  DBI  leadership  for  the  benchmarking  effort: 


Table  II- 1 - Performance  Measures  by  Function 


Functional  Area 

Performance  Measure 

Plan  Review 

1.  Plan  Review  Turnaround  Time 

2.  Inspections  per  Inspector  per  Day 

Inspections 

3.  Inspection  Responses  within  24,  48  Hours 

Together  these  two  functional  areas  employ  over  half  of  the  Department  staff  and 
constitute  the  primary  public  ‘face’  of  the  organization,  and  are  the  most  visible  to 
citizens  at  large.  Inspectors  and  plan  checkers  interact  with  the  public  on  a daily  basis. 
As  detailed  in  the  accompanying  section  on  performance  measures,  the  Department 
tracks  several  measures  of  efficiency  and  effectiveness  for  both  these  functions. 

Selection  of  Comparison  Candidates 

In  consultation  with  Department  management,  KPMG  selected  9 jurisdictions  as 
benchmarking  targets  including  5 from  within  California  and  4 from  outside  the  state. 
KPMG  incorporated  management  suggestions  into  the  selection  of  both  in-and  out-of 
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state  jurisdictions,  and  candidates  were  finalized  for  inclusion  with  management 
agreement. 

KPMG  and  the  DBI  leadership  selected  benchmarking  jurisdictions  based  on  a variety  of 
factors.  While  we  considered  both  population  and  operational  volumes,  neither  were 
decisive  factors  in  determining  prospective  benchmarking  peers.  Rather,  the  reputation 
of  the  city’s  building  inspection/plan  review  department  and  efficiency  of  the  city 
government  in  general  provided  indications  as  to  what  cities  would  yield  valuable 
benchmark/best  practice  data.  Other  considerations  included  proximity,  location  within 
California,  and  the  demands  for  innovation  brought  on  by  increased  construction  growth. 
Additionally,  KPMG  researched  several  supplementary  candidates  to  ensure  we  obtained 
the  most  useful  benchmarking  best  practice  information  for  comparison  and/or  analysis. 

Data  Collection  Activities 

The  project  team  employed  a variety  of  methods  to  survey,  select  and  gather  data  from 
the  jurisdictions  benchmarked.  These  included: 

Preliminary  Survey 

■ Reviewed  national  local  government  associations  to  identify  existing  research. 

■ Examined  collected  online  audit  resources  including  audit  records  from  selected 
municipalities. 

■ Researched  municipal  and  department  websites  to  determine  existence  of  recent 
audits,  innovative  practices  and  general  department  structure. 

Candidate  Screening 

■ Developed  list  of  prospective  candidates  from  preliminary  survey. 

■ Solicited  DBI  input  on  candidate  list. 

Data  Collection 

■ Conducted  telephone  interviews  with  key  management  responsible  for 
performance  measurement  within  each  department. 

■ Confirmed  accuracy  of  information  gathered  through  facsimile  summaries  and 
additional  telephone  inquiries  as  needed. 


Tables  H-2  and  II- 3 on  the  following  pages  outline  key  performance  data  on  the 
jurisdictions  selected. 
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Table  II-2  - Key  Data  on  Benchmark  Jurisdictions  - California 


Jurisdiction* 

Population 

Annual  Volumes** 

Comments 

City  of  San 
Diego,  CA 

1.2  million 

■ 30,000  permits 
issued 

■ 3740  plans  reviewed 

■ 162,327  inspections 
performed 

DBFs  Director  has  recognized  the  City  of 
San  Diego’s  Planning  and  Development 
Review  Department  for  its  innovative 
approaches  to  customer  service. 

County  of  San 
Diego,  CA 

1 . 5 million 

■ 10,000  permits 
issued 

■ 1783  plans  reviewed 

■ 35,014  inspections 
performed 

Serves  all  unincorporated  county  areas 
including  those  adjacent  to  the  City  of  San 
Diego. 

City  and 
County  of  San 
Francisco 

790,000 

■ 53,000  permits 
issued 

■ 9000  plans  reviewed 

■ 127,000  inspections 
performed 

Subject  organization. 

City  of  San 
Jose,  CA 

910,900 

■ 41,006  permits 
issued 

■ 7,927  plans 
reviewed 

■ 228,101  inspections 
performed 

The  San  Jose  Department  of  Planning, 
Building  and  Code  Enforcement  maintains 
a comprehensive  performance 
measurement  program,  including  quality 
audits. 

County  of 
Santa  Clara, 
CA 

1 .6  million 

■ 28,567  permits 
issued 

■ 13,037  plans 
reviewed 

■ 1 8,209  inspections 
performed 

Serves  all  unincorporated  county  areas 
including  those  adjacent  to  the  City  of  San 
Jose. 

City  of 

Sunnyvale,  CA 

132,900 

■ 4,881  permits  issued 

■ 1,191  plans 
reviewed 

■ 31,977  inspections 
performed 

The  City  of  Sunnyvale  utilizes  budget-tied 
performance  measures  in  all  of  its  city 
departments.  In  1994,  the  Commission  on 
Reinventing  Government  headed  by  Vice 
President  A1  Gore  recognized  the  City  for 
its  performance  budgeting  efforts. 

* Detailed  profiles  of  each  of  the  benchmark  jurisdictions  surveyed  can  be  found  in  Appendix  C of  this 
report. 

**  Includes  estimated  figures  for  FY  1998/99. 


Note:  Data  for  all  benchmark  cities  obtained  from  survey  instrument  responses.  Data  for  City  and  County 
of  San  Francisco  obtained  from  the  Department  of  Building  Inspection. 
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Table  II-3  - Key  Data  on  Benchmark  Jurisdictions  - Out  of  State 


Jurisdiction 

Population 

Annual  Volumes* 

Comments 

City  of  Las 
Vegas,  NV 

452,000 

■ 35,000  permits 
issued 

■ 6,000  plans 
reviewed 

■ 350,000  inspections 
performed 

■ DBI’s  Director  recognized  the  City 
of  Las  Vegas  Bureau  of  Building 
and  Safety  for  its  flexible  approach 
to  plan  review  activities. 

■ The  City  has  adopted  several 
innovations  to  deal  with  recent 
rapid  growth. 

City  of  Phoenix, 
AZ 

1.2  million 

■ 27,000  permits 
issued 

■ 4,000  plans 
reviewed 

■ 27,000  inspections 
performed 

■ In  1993,  the  City  of  Phoenix  was 
selected  as  the  winner  of 
Germany’s  Bertelsmann  Prize  as 
the  best-run  city  government  in  the 
world.  The  contest  assessed 
customer  service,  decentralized 
management,  planning  and 
financial  controls,  employee 
empowerment  and  administrative 
innovation. 

■ The  City’s  Development  Services 
Department  is  currently 
implementing  a team  approach  to 
customize  plan  reviews  of  larger 
projects. 

City  of 
Portland,  OR 

510,000 

■ 49,814  permits 
issued 

■ 18,278  plans 
reviewed 

■ 176,290  inspections 
performed 

■ The  Auditor  of  the  City  of  Portland 
has  a vigorous  performance  audit 
program,  and  lead  the  design  of  a 
performance  reporting  program  for 
major  city  functions. 

■ The  City’s  Bureau  of  Buildings 
was  most  recently  audited  in  FY 
97/98.  The  Bureau  is  currently 
negotiating  arrangements  with 
other  City  departments  to  reduce 
total  plan  review  process  times. 

City  of  Seattle, 
WA 

(inspections 

only) 

540,000 

■ 25,000  permits 
issued 

■ 85,000  inspections 
performed 

The  City  of  Seattle  relies  on  manual 
tracking  to  monitor  the  performance  of  its 
inspection  staff.  It  is  currently  engaged  in 
a search  to  identify  an  automated  system 
that  will  incorporate  this  function. 

* Detailed  profiles  of  each  of  the  benchmark  jurisdictions  surveyed  can  be  found  in  Appendix  C of  this 
report. 

**  Includes  estimated  figures  for  FY  1998/99. 
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Findings  and  Gap  Analysis 

To  analyze  the  data  collected,  KPMG  performed  a gap  analysis  to  identify  differences 
between  the  Department  and  the  jurisdictions  surveyed.  The  gap  analysis  yielded  several 
pertinent  findings  relevant  to  the  Department’s  performance  measurement  system  and  to 
its  specific  performance  target  goals.  Less  useful  information  was  uncovered  with 
respect  to  the  Department’s  level  of  performance  in  key  categories. 

Results  of  the  benchmarking  analysis  are  discussed  below  for  the  inspections  and  plan 
review  functions  with  separate  assessments  of  the  overall  performance  measurement 
system  and  specific  performance  measure  target  goals.  While  the  Department  compares 
favorably  to  the  jurisdictions  benchmarked  in  some  areas,  opportunities  for  improvement 
exist  elsewhere.  Detailed  information  on  the  performance  levels  of  designated  peer 
organizations  may  be  found  in  Appendix  C. 


Inspections 

Performance  Measurement  Systems 
II-l.  Finding 

Performance  measures  used  by  the  Department  to  track  the  efficiency  and  effectiveness 
of  inspection  staff  compare  favorably  to  those  in  use  in  jurisdictions  surveyed. 

Analysis 

The  Department  utilizes  two  measures  to  track  inspection  staff  performance.  These  are: 

* Efficiency  Measure 

Inspections  per  Inspector  per  Day  - a measure  of  the  efficiency  of  inspection  staff 
in  completing  assigned  inspections 

* Effectiveness  Measure 

Percentage  of  Inspection  Requests  Responded  to  Within  24  Hours  - a measure  of 
the  effectiveness  of  inspection  staff  in  providing  customer-responsive  inspection 
services 

Of  the  9 jurisdictions  surveyed,  four  employ  both  of  the  measures  noted  above.  The 
remaining  six  jurisdictions  use  only  the  effectiveness  measure,  or  some  variation, 
tracking  the  percentage  of  inspection  response  by  the  next  business  day  or  by  customer 
time  requested. 

All  jurisdictions  attempt  to  equalize  workloads  among  inspectors  by  reviewing  job 
assignments  on  a daily  basis  or  designating  certain  staff  as  ‘floaters’  able  to  assist 
inspectors  in  districts  with  a particularly  high  demand  for  inspections.  Not  all,  however, 
measure  the  ‘productivity’  of  inspectors  as  a group  or  at  an  individual  level  to  identify 
consistent  patterns  of  low  performance  as  does  the  City  and  County  of  San  Francisco. 
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11-2 . Finding 

The  current  system  for  auditing  inspection  quality  risks  subjectivity  in  audit  results . 
Survey  jurisdictions  offer  some  examples  of  how  quality  control  checks  can  be 
structured  to  decrease  the  risk  of  subjectivity. 

Analysis 

To  audit  the  quality  of  inspections,  the  Department’s  senior  inspectors  conduct  monthly 
‘ride-alongs’  with  one  of  the  inspectors  reporting  to  them  and  file  a monthly  report  with 
management.  Our  survey  of  other  jurisdictions  found  that  the  best  utilize  cross  checks  by 
senior  personnel  or  peers  who  do  not  work  together  on  a daily  basis.  These  checks  are 
designed  to  assess  both  the  quality  of  inspections  performed  and  accuracy  of  data 
gathered  on  inspection  workloads.  The  checks  also  serve  to  identify  areas  where  staff 
could  benefit  from  further  training  or  the  sharing  of  knowledge,  and  reinforce  the  need 
for  a consistent  application  of  inspection  criteria. 

Methods  used  to  assess  inspection  quality  or  data  accuracy  include  the  following: 

■ Peer  reviews  of  inspections  in  other  inspection  districts  are  conducted  at  random  with 
a goal  of  95%  accuracy. 

■ Supervisors  perform  random  ‘ride-alongs’  with  inspectors  and  unscheduled  reviews 
of  inspections. 

■ Senior  inspectors  select  five  completed  inspections  per  month  at  random  for  review  of 
quality  and  accuracy  of  paperwork. 

■ Senior  inspectors  physically  re-enact  a given  day’s  inspection  routine  for  each 
inspector  once  yearly  to  assess  inspection  quality  and  accuracy  of  time,  mileage  and 
other  data  recorded. 

II-3.  Finding 

The  majority  of  jurisdictions  surveyed  utilize  performance  measures  to  identify  needs 
for  additional  training  and  staffing  over  the  long  term,  while  relying  on  daily 
equalization  of  workloads  across  inspector  districts  in  the  short  term.  The  DBI  does 
not  make  use  of  such  information  to  identify  technical  training  requirements  of  its 
employees. 

Analysis 

The  majority  of  jurisdictions  surveyed  utilize  performance  measures  selectively  over  the 
long  term.  Consistent  under-performance  is  considered  an  initial  indicator  that  additional 
training  may  be  necessary  for  particular  inspectors,  only  after  other  explanatory  factors 
such  as  transportation  difficulties  in  the  assigned  district,  have  been  investigated.  In  the 
short  term,  on  a daily  and  weekly  basis,  workloads  are  equalized  across  inspector  districts 
with  the  use  of  ‘floater’  inspectors  without  assigned  districts  or  redistribution  of 
inspection  assignments. 
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As  discussed  in  the  section  on  Organizational  Analysis,  the  Department  does  not  appear 
to  have  an  established  system  to  formulate  training  priorities.  It  is  also  unclear  if  the 
inability  to  meet  performance  targets  over  the  long  term  results  in  the  reassessment  of 
staffing  needs. 

Performance  Measure  Targets 
11-4 . Finding 

The  Department’s  performance  measure  targets  for  inspections  lag  behind  those  of 
other  jurisdictions  surveyed  in  the  area  of  response  time  effectiveness  but  compare 
favorably  in  the  area  of  per  inspector  efficiency.  Only  in  those  jurisdictions  employing 
combination  inspectors  for  residential  inspections  and  including  a large  number  of 
easy-to-inspect  ‘tract’  housing  developments  were  efficiency  targets  substantially 
higher. 

Analysis 

Department  targets  for  response  time  effectiveness  are  lower  than  jurisdictions  surveyed. 

■ Until  recently,  the  Department  maintained  a target  of  80%  of  inspections 
performed  within  24  hours  of  request.  Survey  jurisdictions  maintain  targets  of  90 
- 95%  for  the  same  response  time  period. 

■ The  Department’s  recently  adopted  target  of  100%  of  inspections  performed 
within  48  hours  is  consistent  with  one  survey  jurisdiction.  However,  this 
jurisdiction  maintains  a complementary  target  of  90%  of  inspections  performed 
within  24  hours. 

Several  reasons  may  account  for  this  target  measure  variation  when  compared  to  the  most 
common  target  measure  among  the  benchmarking  jurisdictions.  Many  of  the 
jurisdictions  surveyed  noted  their  use  of  24-hour,  interactive  voice  response  (IVR)  system 
to  expedite  the  inspection  scheduling  process.  The  Department  does  not  utilize  such  a 
system  and  each  inspection  division  employs  different  scheduling  procedures. 
Additionally,  some  question  remains  as  to  the  accuracy  of  data  collection  activities 
supporting  the  tracking  of  percentage  of  inspections  performed  within  the  24  and  48  hour 
time  windows.  These  issues  are  discussed  further  in  the  section  on  performance 
measures. 

Department  targets  for  inspector  efficiency  compare  well  with  those  in  other  jurisdictions 
although  this  indicator  is  highly  dependent  on  geographic,  types  of  construction,  and 
other  characteristics  unique  to  each  locale.  Higher  inspector  efficiency  targets 
maintained  by  other  jurisdictions  applied  to  inspectors  with  a high  density  of  residential 
tract  housing  in  their  districts.  Rapid,  multiple  inspections  of  such  housing  stock  are 
possible  due  to  the  uniform  nature  of  construction.  Comparative  data  on  performance 
measure  targets  is  displayed  on  the  following  page  (Table  II-4). 
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Table  II-4  - Comparisons  of  Inspection  Performance  Measure  Targets 


California  Jurisdictions 

Out  of  State  Jurisdictions 

Performance 

Measure 

City  & 
County  of 
San 

Francisco 

County 
of  Santa 
Clara 

County 
of  San 
Diego 

City  of 
San 
Diego 

City  of 
San 
Jose 

City  of 
Sunnyvale 

City  of 
Las 
Vegas, 
NV 

City  of 
Seattle, 
WA 

City  of 
Portland, 
OR 

City  of 
Phoenix, 
AZ 

Inspections/ 

Inspector 

/Day 

11 

NA1 

8.4 

NA 

NA 

NA 

22-23 

NA 

10-  16 
(per  type) 

12-18 

(per 

type) 

Percentage  of 
Inspections 
Responses 
within  24 
hours  (or  As 
Scheduled) 

80% 

100%  w/in 
48  hrs 

90% 

100% 

95% 

95% 

100% 
w/in 
48  hrs 

90% 

95% 

95% 

95% 

90% 

Jurisdictions  not  employing  this  performance  measure. 


Plan  Review 

Performance  Measurement  Systems 
II-5.  Finding 

The  Department  is  consistent  with  survey  jurisdictions  in  its  overall  approach  to 
measuring  plan  review  effectiveness  and  goes  beyond  the  norm  in  its  measurement  of 
plan  review  staff  efficiency. 

Analysis 

All  of  the  jurisdictions  surveyed  measured  the  time  required  to  review  plans.  The  plan 
type  categories  established,  however,  varied  widely,  as  did  the  target  times  associated 
with  each  category.  Plan  review  times  provide  a direct  measure  of  what  matters  to  the 
customer  most,  and  a valuable  indicator  of  the  need  to  reassess  work  processes,  training, 
and  if  necessary,  staffing  levels,  to  maintain  customer  service  standards.  Only  one  other 
jurisdiction  uses  a specific  measure  of  staff  efficiency  as  in  San  Francisco,  and  restricts  it 
to  internal  use  for  identifying  the  need  for  training  or  a change  in  plan  review  technique. 

11-6.  Finding 

While  all  survey  jurisdictions  measured  plan  review  times , several  found  the 
measurement  of  initial  review  time  coupled  with  the  number  of  revisions , rather  than 
overall  plan  review  time , to  be  a more  useful  management  tool. 

Analysis 

Plans  commonly  proceed  through  two  or  more  rounds  of  review  before  final  approval. 
After  an  initial  review,  the  customer  must  make  revisions  to  the  plans  based  on  the 
reviewer’s  comments  before  the  process  can  proceed.  This  review,  comment,  revision, 
review  cycle  repeats  until  the  reviewer  is  satisfied  that  the  plans  presented  meet 
requirements  for  approval.  Very  few  plans  are  approved  without  the  need  for  revisions. 

KPA4G 
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Several  jurisdictions  focus  on  the  time  for  the  initial  plan  review  as  the  more  valuable 
indicator  because  it  represents  that  step  in  the  process  most  subject  to  the  plan  reviewer’s 
control.  By  contrast,  the  overall  plan  review  time  includes  those  periods  in  which  plans 
have  been  returned  to  the  customer  for  revisions.  Overall  process  times  can  vary  widely 
depending  on  the  time  taken  by  the  customer  to  complete  and  resubmit  a revised  plan  set. 

An  additional  (though  not  explicit)  measure  used  by  one  jurisdiction  is  the  number  of 
follow-on  reviews  needed.  Management  in  this  jurisdiction  believes  a thorough  initial 
review  can  minimize  the  need  for  further  follow-on  reviews.  For  repeat  customers,  the 
initial  review  can  act  as  a ‘training’  tool.  Consistent  rejection  of  construction  practices  or 
features  in  the  initial  review  can  lessen  the  likelihood  that  customers  will  attempt  to 
‘shortcut’  code  requirements  intentionally  or  through  unfamiliarity  with  procedures. 

Performance  Measure  Targets 

11-7.  Finding 

While  comparison  of  actual  target  times  per  plan  type  across  jurisdictions  surveyed  is 
difficult  due  to  variations  in  category  definition,  the  Department’s  levels  for 
compliance  with  its  own  target  times  are  consistent  with  the  norm  among  peer 
jurisdictions. 

Analysis 

Almost  all  jurisdictions  surveyed  set  their  target  levels  at  90%,  attempting  to  review  this 
percentage  of  plans  within  the  target  times  established.  San  Francisco  sets  its  target 
levels  at  85%  for  commercial  plans  and  90%  for  residential  plans.  Many  others  listed 
target  times  for  plan  review  but  did  not  establish  goals  for  the  percentage  of  plans  to  be 
reviewed  within  this  time.  A comparison  of  target  levels  in  the  jurisdictions  surveyed 
(Table  EL-5)  is  outlined  below. 


Table  II-5  - Comparisons  of  Plan  Review  Performance  Measure  Targets 


California  Jurisdictions 

Out  of  State  Jurisdictions 

Performance 

Measure 

City  & 
County  of 
San 

Francisco 

County 

of 

Santa 

Clara 

County 
of  San 
Diego 

City 

of 

San 

Diego 

City 

of 

San 

Jose 

City  of 
Sunnyvale 

City  of 
Las 
Vegas, 
NV 

City  of 
Seattle, 
WA 

City  of 
Portland, 
OR 

City  of 
Phoenix, 
AZ 

Percentage  of 
Plans 
Reviewed 
within  Target 
Time 

85% 

commercial 

90% 

residential 

90% 

99% 

85% 

90% 

90% 

NA1 

NA 

NA 

NA 

90% 

1 Jurisdictions  not  employing  this  performance  measure. 
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Additional  Observations 

In  addition  to  our  review  of  performance  measure  systems  and  targets,  KPMG  asked  each 
jurisdiction  about  select  business  practices  used  throughout  the  plan  review  and 
inspection  process.  Our  research  yielded  several  responses  involving  both  long-time 
practices  by  the  departments  surveyed  as  well  as  innovative  new  approaches  still  in  the 
trial  stage.  Many  of  the  practices  listed  contribute  to  the  quantitative  benchmarking 
results  noted  above  and  suggest  potential  innovations  for  examination  by  the  City  and 
County  of  San  Francisco. 

Inspections 

II-8.  Finding 

Almost  all  survey  jurisdictions  utilize  combination  inspectors  for  at  least  some 
inspection  duties.  Only  one  jurisdiction  follows  the  Department’s  practice  of 
employing  separate  inspection  staffs  by  inspection  type  for  all  inspections. 

Analysis 

Combination  inspectors  hold  multiple  certifications  allowing  them  to  conduct  structural, 
electrical,  mechanical  and  plumbing  inspections  at  the  same  time  on  a construction  site. 
The  advantages  of  combination  inspection  are  especially  useful  when  inspection  sites  are 
separated  by  long  distances  as  travel  times  can  be  minimized.  Less  complex  residential 
construction  is  the  most  common  candidate  for  combination  inspections.  Utilizing 
combination  inspectors  for  commercial  construction  is  less  common  due  to  both  the 
difficulty  of  retaining  experienced  and  qualified  staff,  and  the  complexity  of  construction 
techniques  used  in  many  larger  commercial  projects.  The  use  of  combination  inspection 
in  the  survey  jurisdictions  (Table  EI-6)  is  summarized  below. 


Table  II-6  - Usage  of  Combination  Inspectors 


Jurisdiction 

Combination  Inspector  Usage 

California  Jurisdictions 

San  Diego 

1 - 2 family  residential  construction 

County  of  San  Diego 

All  construction 

County  of  Santa  Clara 

All  construction 

Sunnyvale 

All  construction 

Out  of  State  Jurisdictions 

Las  Vegas,  NV 

All  construction 

Phoenix,  AZ 

All  construction 

Portland,  OR 

All  construction  except  major  commercial 

11-9.  Finding 

Several  survey  jurisdictions  have  adopted  innovative  programs  to  better  serve 
inspection  customers.  Some  of  these  programs  may  offer  guidance  for  the  Department 
in  its  on-going  efforts  to  enhance  customer  service. 
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Analysis 

Increased  customer  service  can  often  be  achieved  by  ‘customizing’  services  for  certain 
customer  groups.  The  Department  has  already  introduced  some  ‘special’  services 
including  the  One  Stop  Permit  program  and  a recent  Express  Window  for  certain  permits. 
In  considering  such  efforts,  an  organization  must  also  assess  the  effect  providing  such 
‘special’  services  will  have  on  general  operations,  and  by  extension,  service  to  customers 
as  a whole. 

Excessive  attention  to  the  demands  of  specific  customers  can  not  only  detract  from 
overall  customer  service,  it  may  encourage  unreasonable  customer  expectations.  The 
experiences  of  other  jurisdictions  in  offering  specialty  services  while  maintaining  general 
standards  can  provide  valuable  assistance.  Two  such  specialty  services  for  the  inspection 
function  are  noted  below. 

Permit  by  Inspection  - This  City  of  Phoenix,  Arizona  program  allows  inspectors  to 
issue  permits  for  simple  construction  work  out  in  the  field  after  an  on-site  inspection.  In 
exchange  for  convenience,  the  builder  must  bear  the  risk  that  already  finished  work  may 
not  meet  code  standards. 

Master  Permits  and  Accelerated  Permits  - These  two  programs  instituted  by  the  City 
of  Indianapolis,  Indiana  target  specific  customer  groups.  A Master  permit  may  be  issued 
to  a contractor  that  consolidates  the  number  of  inspections  and  permits  required.  If  the 
developer  is  using  the  same  contractors  throughout  the  entire  project  or  most  of  it,  the 
contractors  may  qualify  for  a Master  permit.  Accelerated  permits  can  be  requested  for 
emergency  or  time  sensitive  projects.  The  permit  guarantees  the  performance  of 
necessary  inspections  within  2 hours  of  phone  notification.  An  additional  fee  is  charged. 
(Note:  Although  the  City  of  Indianapolis  was  not  one  of  our  final  benchmark 
jurisdictions  due  to  insufficient  information,  we  have  included  this  brief  description  on 
two  of  its  more  innovative  programs.) 


Plan  Review 

11-10.  Finding 

Several  survey  jurisdictions  have  adopted  innovative  programs  to  streamline  the  plan 
review  function.  Some  of  these  programs  may  offer  alternatives  to  the  Department  in 
its  on-going  efforts  to  enhance  customer  service. 

Analysis 

Inter-Department  Agreements  on  Average  Turnaround  Times  - Management 
initiatives  in  Portland,  Oregon  include  a current  review  of  the  permit  approval  time  per 
department.  This  review  would  seek  to  determine  the  average  time  needed  by  each 
department  for  its  review  of  permit  applications,  including  planning,  public  works  and 
other  city  departments  as  well  as  the  Bureau  of  Buildings.  The  Bureau  is  negotiating 
agreements  with  each  city  department  involved  in  plan  review  specifying  customer 
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service  and  other  goals.  These  agreements  will  eventually  be  expanded  to  include 
approval  time  targets  for  each  department  involved. 

Team  Approach  to  Plan  Review  - For  major  projects,  Phoenix,  Arizona  has  initiated  a 
team  approach  to  plan  review.  Project  review  teams  include  representatives  from 
planning,  civil  engineering,  building  safety  and  field  inspections,  and  are  supported  by  a 
clerical  staff  member  and  a Technical  Research  group.  A Project  Manager  coordinates 
teamwork  and  serves  as  a single  point  of  contact.  Managers,  drawn  from  experienced 
staff,  are  expected  to  customize  the  plan  review  approach  and  schedules  taking  advantage 
of  project  characteristics  that  may  allow  a more  flexible  review  process  while  still 
adhering  to  city  policy.  A written  agreement  including  timelines,  estimated  fees  and 
submittal  requirements  is  made  with  the  developer’s  team. 

Express  Customized  Plan  Review  - Las  Vegas,  Nevada  provides  developers  with  the 
opportunity  to  ensure  compliance  with  all  applicable  construction  codes  in  a single 
meeting  through  its  Express  Plan  Review  program.  By  appointment,  members  of  the 
developer’s  team  meet  jointly  with  a team  of  plan  review  professionals  (including 
planning,  land  development  and  fire  plan  reviewers  in  addition  to  plumbing/mechanical, 
electrical  and  structural  reviewers)  to  resolve  all  compliance  issues.  The  meeting 
continues  until  all  issues  are  resolved,  or  necessary  revisions  are  found  which  cannot  be 
accomplished  within  the  meeting  format.  Those  using  the  Express  Plan  Review  system 
are  required  to  have  any  planning,  zoning  approvals  before  making  appointments,  and 
must  submit  a complete  set  of  plans  at  least  two  weeks  in  advance. 

Recommendations 

Inspections 

II-l.  Consider  modifying  the  current  system  for  auditing  the  quality  of  inspections  to 
minimize  the  review  of  inspectors  work  by  directly  supervising  superiors. 

As  detailed  in  the  finding  above,  survey  jurisdictions  offer  several  examples  of  how 
quality  control  checks  can  be  implemented  utilizing  cross-section  or  peer  reviews  that 
minimize  the  potential  for  subjective  assessments  when  reviewing  direct  reports. 

II-2.  Assess  the  potential  for  efficiency  gains  by  utilizing  combination  inspectors  to 
inspect  certain  types  of  construction,  and  convert  a limited  number  of  inspectors  to 
combination  duty  if  warranted. 

Most  jurisdictions  surveyed  use  combination  inspectors  for  at  least  some  of  their 
inspections,  especially  of  residential  construction.  Limited  usage  of  combination 
inspectors  can  yield  time  and  travel  efficiencies. 

11-3.  Revisit  the  use  and  the  ability  to  achieve  24-hour  turnaround  target  times  ( rather 
than  48-hour)  after  reforms  utilizing  new  technologies  are  made  to  inspection 
scheduling  practices  and  performance  measure  data  collection  procedures. 
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Almost  all  the  jurisdictions  surveyed  used  24-hour  turnaround  target  times.  While 
circumstances  of  City  and  County  geography  and  transportation  external  to  the 
Department  may  warrant  the  recently  introduced  48-hour  target,  efficiency  gains  from 
internal  reforms  including  technologies  and  more  accurate  use  of  performance  measures 
have  yet  to  be  explored. 

Plan  Review 

II-4.  Establish  target  times  for  initial  plan  reviews  and  measure  the  number  of  plan 
revisions  to  better  assess  and  control  reviewer  vs.  customer  contributions  to  total  plan 
review  time. 

Current  performance  measures  track  the  overall  permit  processing  time  including  the 
time  plans  are  ‘on  hold’  as  the  Department  waits  for  plan  revisions  to  be  submitted  by  the 
customer.  Initial  plan  review  time  (along  with  ‘backlog’  time  as  noted  in  the  section  on 
performance  measures)  is  a more  accurate  measure  of  that  part  of  the  process  over  which 
the  Department  has  control  and  can  strive  to  minimize. 

II-5.  Assess  the  potential  for  establishing  agreements  specifying  plan  review  target 
times  and  other  customer  service  goals  with  other  city  departments  to  shorten  and 
increase  the  predictability  of  total  plan  review  times. 

Overall  plan  review  time  includes  that  required  by  city  departments  other  than  the  DBI. 
Established  time  frames  for  the  review  of  plans  by  other  departments  would  allow  the 
DBI  to  provide  estimates  of  total  plan  check  time  with  greater  accuracy.  In  the  future, 
consider  expanding  such  interdepartmental  cooperation  to  allow  for  combined  plan 
review  teams  from  the  relevant  city  departments  similar  to  those  in  other  jurisdictions 
surveyed. 
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Comparative  Performance  Assessment 
Introduction 

Data  gathering  for  our  initial  benchmarking  survey  provided  comparative  information  on 
the  functions  most  central  to  the  DBFs  mission  - that  is,  inspections  and  plan  review. 

To  develop  a more  comprehensive  picture  of  the  Department’s  performance  in 
comparison  with  that  of  high-performing  peers,  KPMG  conducted  a supplemental  survey 
soliciting  information  on  performance  measures  and  best  practices  of  three  select 
municipalities.  From  this  information,  KPMG  developed  a comparative  scorecard 
assessing  CCSF  performance  with  respect  to  its  peers  on  per  measure  or  practice  basis. 
This  scorecard  provided  the  basis  for  our  assessment  of  the  Department’s  comparative 
performance.  We  discuss  our  approach  and  analysis  as  outlined  below: 

■ Selection  of  Supplemental  Benchmarking  Candidates 

■ Comparative  Scorecard  of  Performance  Measures  and  Best  Practices 

■ Assessment  of  Comparative  Performance 


Selection  of  Supplemental  Benchmarking  Candidates 

The  following  three  jurisdictions  were  chosen  as  targets  of  KPMG’s  supplemental 
benchmarking  survey  for  the  CCSF  DBI  performance  audit.  Each  jurisdiction  has 
received  recognition  for  its  commitment  to  excellence  in  government,  and  in  some  cases, 
has  recently  implemented  performance  improvement  reforms  in  its  building  plan  review 
and  inspection  operations.  The  table  below  lists  the  jurisdictions  and  reasons  for  their 
selection  as  entities  with  superior  operational  performance  and  practices. 


Table  II-7  - Target  Jurisdictions  for  Supplemental  Benchmarking  Survey 


Jurisdiction 

Population 

Recognition  for  Superior  Performance  and  Practices 

City  of  Phoenix, 
AZ 

1.2  million 

■ In  1993,  the  City  of  Phoenix  was  selected  as  the  winner  of 
Germany’s  Bertelsmann  Prize  as  the  best-run  city  government 
in  the  world.  The  contest  assessed  customer  service, 
decentralized  management,  planning  and  financial  controls, 
employee  empowerment  and  administrative  innovation. 

■ The  City’s  Development  Services  Department  is  currently 
implementing  a team  approach  for  its  plan  review  function. 

City  of 
Portland,  OR 

510,000 

■ The  Audit  Services  Division  of  the  City  of  Portland  has  been  a 
winner  or  finalist  for  the  Knighton  Award  for  Best  Audit  from 
1995  to  1998.  This  award  is  presented  annually  by  NALGA 
(National  Association  of  Local  Government  Auditors)  in 
recognition  of  excellence  in  government  auditing.  The 
Division  lead  the  design  of  a performance  reporting  program 
for  major  city  functions. 

■ The  City’s  Bureau  of  Buildings  was  most  recently  audited  in 
FY  1997-98.  The  Bureau  is  currently  implementing  its 
‘Blueprint  2000’  process  improvement  effort  including  the 
introduction  of  new  permit  processing  software. 

KPMG 
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Table  II-7  - Target  Jurisdictions  for  Supplemental  Benchmarking  Survey  (cont.) 


Jurisdiction 

Population 

Recognition  for  Superior  Performance  and  Practices 

City  of 

Indianapolis,  IN 

1 .4  million 

■ Under  the  leadership  of  former  Mayor  Steven  Goldsmith, 
municipal  government  operations  throughout  the  City  of 
Indianapolis  were  subject  to  comprehensive  operational 
improvement  reforms.  KPMG  professionals  participated 
extensively  in  this  effort. 

■ The  Indianapolis  Department  of  Metropolitan  Development, 
like  other  city  departments,  employs  technology  strategically 
allowing  a high  degree  of  Internet,  phone  and  facsimile  access 
to  its  services. 

Comparative  Scorecard  of  Performance  Measures  and  Best  Practices 
KPMG  selected  seven  performance  measures  and  seven  best  practice  indicators  to 
develop  a ‘scorecard’  of  the  DBFs  performance  in  comparison  to  the  selected 
municipalities.  The  seven  measures  and  practices  address  the  plan  review,  permit 
processing,  inspections  and  code  enforcement  functions— assessing  dimensions  of 
efficiency,  effectiveness  and  customer  service  quality.  Scorecard  results  and  data  are 
presented  in  summary  form  on  the  following  page.  (For  an  extended  version  of  our 
survey  results,  including  descriptions  of  innovative  practices,  see  Supplemental  Appendix 
D.) 
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Table  II  - 8 - Comparative  Scorecard 
CCSF  Comparative  Performance  Against  Select  Jurisdictions  (continued) 
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PERFORMANCE  MEASURES 


Overview 

As  part  of  our  performance  audit  of  the  Department  of  Building  Inspection,  KPMG 
reviewed  measures  of  performance  now  used  by  the  Department.  As  noted  in  the  section 
on  benchmarking,  these  measures  are  used  for  internal  management  purposes.  This 
section  discusses  the  DBFs  performance  measure  system  as  outlined  below: 

■ Approach  to  Performance  Measurement 

■ Data  Collection  Activities 

■ Findings  and  Analysis 

■ Recommendations 


Approach  to  Performance  Measurement 

Performance  measurement  is  not  simply  concerned  with  collecting  data.  It  is  better 
thought  of  as  an  overall  management  system  with  the  goal  of  increasing  the  efficiency 
and  effectiveness  of  the  process  or  the  product.  These  actions  operate  in  a continuous 
cycle  allowing  options  for  expansion  and  improvement  of  the  work  process  or  product  as 
better  techniques  are  discovered  and  implemented.  Without  performance  measures  an 
organization  has  no  way  of  knowing  how  well  it  is  performing,  whether  or  not  it  is 
efficient  or  how  to  improve  its  processes  which  ultimately  define  the  nature  of  its 
business. 

Performance  measures  quantitatively  tell  the  organization  something  important  about  its 
products,  services  and  the  processes  that  produce  them.  They  are  a tool  to  understand, 
manage  and  improve  what  the  organization  does.  If  an  organization  does  not  measure  an 
activity,  it  cannot  control  it.  If  it  cannot  control  it,  it  cannot  manage  it.  Performance 
measures  let  the  organization  know: 

• How  well  it  is  doing; 

• If  it  is  meeting  its  goals; 

• If  the  customers  are  satisfied; 

• If  the  processes  are  in  statistical  control,  and 

• If  and  where  improvements  are  necessary. 

To  be  of  value,  performance  measures  should  be: 

■ Representative  of  actual  efficiency  and  effectiveness; 

■ Linked  to  an  established  goal  or  target  level; 

■ Accurate  and  based  on  consistent  data  collection  and  computation,  and 

■ Employed  by  management  to  identify  problem  areas  and  planned  corrective 
action. 
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The  absence  of  one  of  these  elements  can  jeopardize  the  benefits  of  performance 
measurement  system,  transforming  a robust  system  of  measurement  and  improvement 
into  an  empty  exercise  in  data  collection. 


Data  Collection  Activities 

To  assess  the  extent  to  which  the  Department’s  performance  measurement  system 
satisfies  the  conditions  for  a robust  system,  we  conducted  several  activities.  These 
included: 

Interviews 

The  project  team  conducted  individual  and  focus  group  interviews  with 

■ Deputy  Directors,  Division  Managers,  Chief  Building  Inspectors  and  Senior 
Inspectors  responsible  for  monitoring  performance  measures; 

■ Department  Customer  Service  Manager  responsible  for  the  compiling  quarterly 
data  submitted  by  managers  on  performance  measure  achievement,  and  assessing 
its  consistency  with  data  generated  from  information  systems; 

■ Administrative  and  clerical  staff  responsible  for  data  input  and  calculation,  and 

■ Operational  staff  responsible  for  providing  initial  data  input. 

Review  of  Documentation 

KPMG  gathered  and  analyzed  documentation  from  all  levels  of  the  performance 
measurement  process  including: 

■ Quarterly  management  reports  used  to  prepare  the  Department’s  Quarterly  and 
Annual  Reports; 

■ Weekly  management  reports  from  plan  check  and  inspections  operations; 

■ Routine  and  customized  Permit  Tracking  Information  System  (PTIS)  computer- 
generated  summaries  tracking  process  times  for  key  Department  operations,  and 

■ Samples  of  clerical  logs  for  collecting  initial  data  for  monthly  compilation. 

Observation  of  Data  Collection,  Computation 

KPMG  observed  data  input  activities  and  procedures  including  data  calculations 
performed  by  administrative  support  staff  in  both  Inspections  and  Plan  Check  divisions. 

Analysis  of  PTIS  Reports 

KPMG  conducted  an  extensive  analysis  of  Permit  Tracking  Information  System  (PTIS) 
reports  from  both  the  legacy  Motorola  and  the  Oracle  systems  to: 

■ Estimate  average  review  and  ‘backlog’  or  wait  times  for  each  step  of  the  plan 
check  process  including  by  separate  departments,  and 

■ Evaluate  the  reliability  and  usability  of  reporting  formats. 
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Performance  measures,  in  the  form  of  permit  approval  times  and  inspection  response 
times,  are  in  place  to  measure  this  aspect  of  quality.  However,  the  quality  of  plan  check 
or  inspection  work  is  not  measured  on  an  explicit  basis. 

In  the  area  of  plan  check,  the  Department  has  taken  a step  in  this  direction  by  instituting  a 
quality  control  check  for  all  plans.  This  check  consists  of  an  examination  of  approved 
plans  for  the  appropriate  signatures,  stamps  and  other  markings  ensuring  proper  review 
by  all  relevant  parties.  This  check  is  performed  by  One  Stop  permit  coordinators  and 
permit  clerks.  While  important,  the  focus  of  the  quality  control  check  is  on  procedural 
completeness  rather  than  the  substance  of  the  plan  review  itself.  In  the  area  of 
inspections,  no  explicit  quality  measure  is  apparent. 

As  noted  in  the  section  on  benchmarking,  other  jurisdictions  have  adopted  various 
approaches  to  ensure  work  quality  through  random  checks  of  inspector  or  plan  reviewer 
products  by  either  peers  or  immediate  supervisors.  Such  checks  are  limited  to  avoid 
increasing  day-to-day  workloads.  Still,  they  provide  a good  opportunity  to  identify  lapses 
in  work  and  potential  areas  for  additional  training  for  all  staff. 


Data  Collection  and  Computation 

Data  collection  and  computation  forms  the  foundation  of  a useable  performance 
measurement  system.  This  includes: 

■ Data  entry  by  administrative  and  professional  staff; 

■ Data  compilation  on  weekly,  monthly  or  other  scheduled  basis  by  administrative 
staff;  and 

■ Data  computation  by  administrative  or  management  staff. 

To  the  extent  inaccuracies  and  omissions  exist  in  any  one  of  these  steps,  the  resulting 
performance  measures  will  not  truly  reflect  the  organization ’s  actual  operations,  despite 
the  validity  of  the  measures  themselves.  Often,  due  to  their  routine  nature,  the  accuracy 
and  efficiency  of  data  collection  and  computation  tasks  do  not  receive  the  attention  of 
senior  management. 

Inspections 

Finding 

III-3.  Several  practices  continue  to  be  used  in  data  gathering  and  compilation  for  the 
inspection  function  that  limit  the  accuracy  and  reliability  of  performance  measurement 
data.  Specifically: 

■ No  consistent  definition  of  what  constitutes  an  inspection  exists. 

Analysis 

Clerical  staff  in  all  inspection  divisions  compile  total  inspection  counts  based  on 
inspectors’  daily  logs  in  which  inspections  are  listed  by  site  or  inspection  type.  These 
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inspection  totals  are  self-reported  and  different  inspectors  may  provide  different 
inspection  counts  for  identical  activities.  While  the  Department’s  Oracle  database 
system  counts  inspections  by  inspection  type  and  has  been  introduced  in  one 
inspection  division,  inspection  totals  from  manual  logs  are  still  in  use.  Our 
September  2000  review  confirmed  the  continuation  of  this  condition.  KPMG’s  1999 
review  compared  the  monthly  inspection  count  for  this  same  division  recorded  in  the 
Oracle  system  (5000)  to  that  produced  from  a tabulation  of  daily  logs  for  the  same 
month  (4618)  and  noted  a disparity  of  approximately  9%. 

■ No  automated  check  exists  to  confirm  the  accuracy  of  inspection  response 
times. 

Analysis 

In  both  our  1999  and  2000  reviews,  we  found  that  inspection  response  times  are 
tabulated  from  daily  log  entries  by  inspectors.  Inspectors  self-report  the  number  of 
inspections  responded  to  within  24  or  48  hours  (or  as  requested)  on  each  daily  log 
sheet.  At  month  end,  these  figures  are  totaled  by  clerical  staff  and  reported  to 
management  for  incorporation  in  performance  measure  totals.  No  automated  check 
exists  to  confirm  the  accuracy  of  these  figures.  These  inaccuracies  may  occur  due  to: 

■ The  lack  of  a uniform  definition  of  an  inspection,  as  noted  above,  and 

■ Inaccurate  calculation  of  response  time  totals. 

Only  the  Building  Inspection  Division  maintains  an  automated  record  of  inspection 
requests.  Clerical  staff  answering  customer  requests  for  inspections  enter  the  time  the 
request  was  made  into  the  Oracle  system.  This  input  is  used  to  produce  daily 
inspection  schedules  for  each  inspector  but  not  to  calculate  inspection  response  times. 
In  the  Plumbing  and  Electrical  Divisions,  the  legacy  Oracle  system  is  in  use  but  paper 
logs  provide  the  only  record  available  for  performance  measurement  data. 

■ Data  input  and  computation  are  time  consuming,  manually  intensive,  and 
require  frequent  transfers  of  data  that  increase  the  potential  for  error. 

Analysis 

Each  inspection  division  performs  its  calculation  of  performance  measures  using 
manually  intensive  processes  subject  to  human  error.  Use  of  the  Oracle  2000  system 
to  automate  calculation  of  performance  measures  has  not  yet  been  implemented. 

■ Building  Inspections  - Clerical  staff  enter  each  inspector’s  daily  inspection 
records  into  both  the  Oracle  system  and  an  Excel  spreadsheet  application  (a 
duplication  of  the  data  entry  process).  The  Excel  spreadsheet  application  is 
used  to  compute  the  number  and  percentage  of  inspections  responded  to 
within  24  and  48-hour  periods.  However,  the  Building  Inspection  division 
has  the  most  automated  data  collection  and  computation  procedures  of  the 
three  inspection  divisions. 
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Survey  of  Management 

A survey  questionnaire  was  administered  soliciting  management  perceptions  of  the  value 
and  fairness  of  current  performance  targets  and  usage. 


Findings  and  Analysis 

This  section  discusses  our  findings  regarding  the  three  major  aspects  of  a functioning 
performance  measure  system.  They  are: 

■ Performance  Measures  - the  actual  measures  or  ratios  chosen  to  provide 
information  on  the  efficiency  and  effectiveness  of  the  organization. 

■ Data  Collection  and  Computation  - the  procedures  and  practices  used  to 
collect  raw  data  and  calculate  the  performance  measure  ratios  on  a periodic 
basis. 

■ Management  Utilization  - how  management  utilizes  performance 
measurement  system  results  to  make  decisions  about  operations. 

Performance  Measures 

Finding 

7/7-7.  The  Department  utilizes  a comprehensive  set  of  performance  measures  and 
targets  to  gauge  productivity  and  customer  service  levels  in  key  functions. 

Analysis 

The  Department’s  “Management  by  Objective”  program  outlines  performance  measures 
and  target  levels  for  most  functions  including  the  inspections  and  plan  review  activities 
most  central  to  the  organization’s  mission.  Performance  measures  are  classified  below 
(Table  HI-1)  by  function  and  organizational  objective. 
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Table  III-l  — Performance  Measures  by  Organizational  Objective  and  Function 


Inspections  (Building, 
Electrical  and  Plumbing)* 


Inspections  per  Inspector  per  Day 


Effectiveness 
( Customer  Service) 


Plan  Review 

(Commercial,  Residential 
and  Mechanical) 


Plan  Review 

(Commercial,  Residential 
and  Mechanical) 


Plans  Reviewed  per  Reviewer  per  Day 


Percentage  of  Permits  Approved  within  24 
Hours,  7,  30  or  90  Days 


Inspections  (Building, 
Electrical  and  Plumbing) 


Percentage  of  Inspection  Responses  within  48 
Hours 


Lead  Hazard  Inspection 


Percentage  of  Inspection  Responses  within  48 
Hours 


Effectiveness 
( Quality ) 


Records  Management 


Percentage  of  Record  Requests  Processed 
within  24  Hours 


Percentage  of  3R  Reports  Processed  within  2 
Days 


No  explicit  measures 


*The  Housing  Inspection  division  does  not  have  any  explicit  efficiency  performance  targets  due  to  the 
varied  nature  of  complaint  inspection  work.  Actual  average  inspections  per  Housing  division  inspector  per 
day  are  4.5. 

Note:  In  addition  to  these  performance  measures,  the  Department  also  gathers  numerous  data  on  aggregate 
volumes  not  listed  above.  Volume  data  reflects  fluctuations  in  activity  but  does  not  provide  information  on 
operational  performance  and  is  not  included  in  our  review.  True  performance  measures  are  unit  based 
often  on  a per-dollar  or  per-time  period  basis. 


Finding 

III-2.  Performance  measures  for  the  two  key  functions  of  plan  checking  and 
inspections  are  well  developed  in  the  areas  of  productivity  and  customer  service  but  do 
not  include  explicit  measures  of  work  quality. 

Analysis 

The  speed  with  which  the  Department  reviews  plans  or  responds  to  inspection  requests 
plays  a large  part  in  influencing  the  customer’s  perception  of  the  quality  of  DBI  services. 
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■ Electrical  Inspections  - The  current  process  for  gathering  and  reporting 
monthly  performance  measures  involves  numerous  steps  and  several 
transfers  of  data.  These  include: 

1 . Calculation  of  inspectors’  daily  productivity; 

2.  Calculation  of  total  inspections  from  daily  logs; 

3.  Transfer  of  results  to  14-column  accounting  paper,  and 

4.  Additional  calculations  of  permits  approved,  active  permits, 
inspections  performed  within  24  hours,  total  inspector  days,  and 
average  inspections  per  inspector  per  day. 

These  activities  occupy  four  hours  of  clerical  staff  time  daily. 

■ Plumbing  Inspections  - Processes  used  are  similar  to  those  in  Electrical 
Inspections,  manually  intensive  and  requiring  frequent  transfers  of  data. 

They  include: 

1.  Calculation  of  per  inspector  data  daily  from  daily  inspection  logs; 

2.  Transfer  of  all  individual  inspector  data  to  a daily  summary  form; 

3.  Tallying  of  all  of  individual  daily  summaries  monthly  to  create 
summary,  and 

4.  Submission  of  this  summary  to  a supervisor  who  transfers  the  numbers 
to  a final  inspection  report. 

■ Housing  Inspections  - The  Housing  Inspection  division  relies  on  the  Oracle 
system  and  is  highly  automated.  As  noted  previously,  it  does  not  use  an 
explicit  performance  measure. 


Plan  Check  - Permit  Tracking  Information  System 

Since  our  1999  review,  the  Department  has  migrated  from  the  legacy  Motorola 
information  system  to  an  Oracle-based  system.  The  Oracle  2000  system  draws  on  much 
of  the  same  information  and  report  formats  utilized  in  the  previous  Motorola  system. 
Although  the  Permit  Tracking  System  or  PTS  is  designed  to  track  the  progress  of  a 
permit  from  the  initial  filing  of  the  application  to  issuance,  it  is  the  plans  attached  to  the 
permit  application  that  must  be  approved  before  a permit  is  issued  and  construction  can 
begin.  This  plan  check  and  approval  process  occupies  the  majority  of  the  time  required 
to  process  a permit.  The  following  assessment  of  PTS  issues  focuses  on  the  plan  check 
process. 
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Data  input  practices  and  estimates  used  for  the  plan  check  performance  measures  limit 
the  reliability  and  utility  of  the  data.  Specifically : 

■ Inconsistent  data  entry  tracking  the  progress  of  plans  reviewed  limits  staff 
ability  to  accurately  determine  the  status  of  plans  within  the  process  and  the 
reliability  of  such  information  for  management  decision  making. 

Analysis 

To  determine  the  location  of  plans  in  the  plan  check  process,  customer  service 
representatives,  operational  staff  and  others  must  interpret  online  data  listing  the 
dates  tracking  the  plan  progress.  Inaccuracies  or  omissions  in  the  entry  of  these 
dates  will  prevent  an  accurate  interpretation. 

In  our  1999  review,  KPMG  noted  errors  in  plan  check  hours,  log-in  and  log-out 
dates,  and  hold  times  associated  with  permit  applications  in  both  one  and  three- 
month  samples  of  recent  plan  check  tracking  data.  Both  MIS  and  plan  check 
professionals  confirmed  the  potential  errors  due  to  inconsistent  data  entry 
practices.  Specifically,  errors  noted  included: 

■ Missing  ‘hold  out’  dates  in  three  of  four  randomly  selected  sample 
applications,  and 

■ Extremely  lengthy  ‘hold’  days  for  numerous  permit  applications. 

MIS  staff  assisted  in  identifying  two  possible  explanations  for  these 
conditions. 

■ Incorrect  recording  of  log-in  and  log-out  times 

■ Improper  routing  of  plans  increasing  aggregate  hold  times 

In  our  2000  review,  we  examined  a sample  of  20  permit  applications  tracked 
through  the  One  Stop  permitting  process.  The  One  Stop  process  assigns  a single 
Permit  Coordinator  to  track  the  progress  of  a permit  using  its  own  paper  filing 
system.  We  compared  these  to  routing  dates  recorded  in  Oracle  PTS  system  for 
consistency.  We  found  the  following: 

■ PTS  routing  dates  for  30%  of  the  applications  were  inconsistent  with 
those  recorded  in  corresponding  One  Stop  files,  or  reflected  End  dates 
that  were  earlier  than  Start  dates  for  certain  permit  processing  stages. 

■ PTS  routing  dates  for  35%  of  the  applications  reflected  minor 
inconsistencies  (1-2  day  discrepancies)  with  those  recorded  in  the 
corresponding  One  Stop  files. 

» PTS  routing  dates  for  the  remaining  35%  of  the  applications  were 
consistent  with  those  recorded  in  the  corresponding  One  Stop  files. 
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■ Methods  in  use  to  compute  time  spent  in  ‘bottlenecks’  in  the  plan  check 
process  do  not  provide  an  accurate  picture  of  their  actual  length. 

Analysis 

The  Department  compiles  a number  of  internal  statistics  on  a weekly,  monthly 
and  quarterly  basis  involving  the  plan  check  function.  One  of  the  statistics 
recorded  is  the  number  of  ‘backlog’  days  or  the  number  of  days  a set  of  plans 
must  wait  before  a plan  check  professional  is  able  to  review  it.  (Plans  are 
reviewed  in  order  of  submission.)  The  following  statistics  are  gathered  on  a 
weekly  basis: 

■ Number  of  Plans  Pending  for  Review; 

■ Average  Plans  Reviewed  Per  Person/Day; 

■ Average  Plan  Checker  Available  per  Day,  and 

■ Backlog  Days. 

In  our  1999  review,  KPMG  found  instances  where  figures  submitted  for  some  of 
these  indicators  were  based,  in  some  cases,  on  estimates  or  targets  rather  than 
actual  figures  achieved.  These  figures  are  then  used  to  compute  the  number  of 
backlog  days,  a key  indicator  of  the  duration  of  the  ‘bottleneck’  in  the  system. 
Estimates  and  targets  are  used  in  computation,  in  part,  because  data  available 
from  the  system  is  unreliable. 

Motorola  system  inaccuracies  observed  by  KPMG  included: 

■ Plans  pending  information  dating  back  to  1997  for  a former  Department 
employee,  and 

■ Different  system  responses  to  identical  queries  submitted  less  than  10 
minutes  apart.  (It  appears  the  system  does  not  list  all  of  pending  plans  but 
provides  only  partial  data  for  each  plan  checker.) 

We  were  not  able  to  review  the  calculation  of  backlog  days  during  our  September 
2000  review  but  found  that  supporting  data  was  unavailable  due  to  unresolved 
data  classification  issues  resulting  from  the  migration  to  the  Oracle  2000  system. 
(These  data  classification  issues  delayed  Department  publication  of  key 
performance  indicators  featured  in  quarterly  and  annual  reports.) 


Management  Utilization 

Inspections 

III-4.  Finding 

While  survey  responses  from  managers  in  the  inspection  divisions  indicated  overall 
satisfaction  with  the  current  performance  measurement  system,  actual  use  of 
performance  measures  as  a management  tool  varies  among  them. 
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Analysis 

Along  with  their  peers  in  the  plan  check  function,  managers  in  the  inspections  divisions 
expressed  positive  opinions  on  the  performance  measurement  system  and  the  actual 
performance  goals  set  by  the  Department.  Indications  exist,  however,  that  inspection 
response  times  (a  key  measure)  are  not  considered  an  important  tool  by  managers. 
Inspection  response  times  do  not  drive  their  decision-making  on  the  need  to  supplement 
staff  or  adjust  workloads. 

Instead,  complaints,  weekly  staff  meetings,  and  requests  for  workload  distribution  are 
used  as  proxies  for  this  measure  and  ability  of  inspection  staff  to  maintain  it.  This  may 
be  due  to  management  concerns  about  data  reliability  and  perceptions  that  the  variety  of 
inspection  activities  make  a strict  application  of  performance  measure  targets  impractical. 


Plan  Check  - Permit  Tracking  Information  System 
7/7-5.  Finding 

Current  system  reporting  does  not  accurately  reflect  the  current  organization  nor 
include  a sufficient  level  of  detail  required  to  provide  a relevant  display  of  data. 

Present  plans  for  the  transfer  from  the  legacy  Motorola  to  the  new  Oracle  system  do 
not  appear  to  include  such  revisions  to  report  format  and  content.  Specifically: 

■ Automated  reporting  reflects  the  former  internal  structure  of  the 
Department  as  part  of  the  Department  of  Public  Works  and  has  not  been 
updated  to  reflect  the  current  organization. 

Analysis 

System-generated  reports  reflecting  the  number  of  plans  processed  and  average 
length  of  plan  processing  reflect  two  plan  check  divisions — counter  and  plans 
approval — rather  than  the  residential,  commercial,  major  project,  mechanical  and 
counter  that  exist  today.  Management  does  not  have  access  to  organized  system 
data  reflecting  their  specific  divisions  and  relies  on  information  generated  in  part 
from  estimates  and  targets  as  noted  above. 

■ Current  report  formats  do  not  provide  sufficient  detail  on  the  plan  check 
process  to  allow  management  to  evaluate  division-specific  *, bottlenecks  ’ and 
to  assist  customer  service  staff  in  interpreting  plan  status. 

Analysis 

Department  staff  members  use  an  on-line  plan  check  history  to  identify  the  status 
of  plans  within  the  plan  check  process.  This  history  records  the  beginning  and 
end  dates  of  several  stages  within  the  plan  check  process.  However,  in  the  latter 
stages  of  the  review  process,  it  is  unclear  whether  plans  are  ‘backlogged,’  being 
reviewed,  or  have  been  returned  to  customers  for  revision.  As  discussed  further 
in  the  section  on  Organizational  Analysis,  customer  service  staff  must  frequently 
refer  customer  inquiries  to  the  plan  checker  assigned  when  sufficient  detail  is  not 
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available  on-line.  Comments  from  management  indicate  that  daily  logs,  rather 
than  system  reporting,  are  the  preferred  information  source  when  trying  to  track 
plan  activity  in  a plan  check  division. 

Recommendations 

Performance  Measures 

Inspections 

111-1.  The  Department  should  incorporate  a quality  measure  based  on  limited  random 
sampling  into  its  performance  measurement  system  for  the  two  key  operations  of  plan 
check  and  inspections. 

The  Department’s  current  performance  measurement  system  has  adequate  measures  of 
productivity  and  customer  service,  but  lacks  an  explicit  measure  of  quality.  Integrating  a 
measure  of  quality  into  the  measurement  overall  system  provides  a more  complete 
assessment  of  performance. 

Plan  Check  - Permit  Tracking  Information  System 

III-2.  To  aid  management  in  assessing  plan  check  performance,  the  Department 
should  consider  internal  use  of  three  performance  measures— the  number  of  ‘ backlog  ’ 
days,  the  time  for  initial  plan  review  and  the  number  of  plan  revisions. 

The  current  effectiveness  or  customer  service  oriented  performance  measure  used  by  the 
Department  is  permit  processing  time.  This  measure  includes  but  does  not  isolate  the 
plan  check  review  process,  or  these  components  of  the  process  over  which  the 
Department  has  the  most  control.  By  using  ‘backlog’  days  and  the  other  suggested 
measures  internally,  the  Department  will  be  able  to  more  accurately  assess  and  streamline 
these  steps  in  the  process. 

Data  Collection  and  Computation 

Inspections 

III-3.  The  Department  should  develop  a uniform  definition  of  what  constitutes  an 
inspection  to  be  used  by  all  inspectors  to  increase  the  usefulness  of  the  average 
inspections  per  inspector  per  day  performance  measure. 

Varying  definitions  of  what  constitutes  an  inspection  among  inspectors,  combined  with 
reliance  on  self-reporting,  limit  the  usefulness  of  the  reported  levels  of  this  productivity 
performance  measure.  This  measure  can  help  gauge  individual  productivity  when  factors 
such  as  inspection  complexity  and  district  transportation  difficulties  are  also  considered. 
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III-4.  In  conjunction  with  the  MIS  Division,  the  Inspections  function  should  consider 
utilizing  the  Oracle  system  to  automate  the  calculation  of  inspection  response  times. 

Manually  intensive  processes  for  collecting  and  computing  performance  data,  combined 
with  the  lack  of  an  automated  check,  limit  the  usefulness  of  measures  and  consume 
valuable  clerical  time.  Automation  would  help  address  both  these  issues. 

Plan  Check  - Permit  Tracking  Information  System 

III-5.  The  department  should  take  steps  to  ensure  the  integrity  of  data  collection  by 
emphasizing  the  importance  of  accurate  entry  of  log  in/log  out  dates  by  all  staff. 

The  evaluation  of  plan  check  process  times  and  identification  of  areas  for  improvement 
will  continue  to  be  difficult  without  more  accurate  and  consistent  entries  of  log  in/log  out 
dates  at  each  step  of  the  plan  check  process.  Sound  data  collection  is  essential  to  a 
meaningful  performance  measurement  program. 

III-6.  In  conjunction  with  the  MIS  Division  and  management,  work  to  revise  data 
tracking  and  calculation  procedures  for  ‘backlog  days’  and  other  key  performance 
indicators  in  new  Oracle  system. 

Currently,  plan  check  managers  utilize  their  own  manual  tracking  of  internal  performance 
indicators  because  available  system  reporting  is  either  unreliable  or  too  difficult  to 
interpret.  Along  with  more  consistent  data  entry,  reforms  to  system  reporting  are  key  to 
producing  more  reliable  and  usable  performance  indicators. 

Management  Utilization 

Inspections 

III-7.  Inspection  management  should  re-evaluate  the  potential  for  more  active  use  of 
performance  measures  after  addressing  data  collection  and  computation  issues. 

Current  use  of  performance  measures  for  management  decision-making  is  limited 
because  of  concerns  about  data  reliability  and  fairness  in  application.  As  these  concerns 
are  addressed,  managers  should  move  to  make  greater  use  of  performance  measures  as  a 
management  tool. 

Plan  Check  - Permit  Tracking  Information  System 

III-8.  The  Department  should  review  system  reporting  formats  in  an  effort  to  provide 
clearer  and  more  detailed  data  on  plan  check  status  for  customer  service  staff,  and 
more  relevant  data  to  assist  managers  in  accurately  assessing  plan  check  ‘ bottlenecks . ’ 

Current  display  screens  do  not  always  provide  adequate  information  for  Customer 
Service  staff  to  respond  to  the  most  frequent  customer  inquiries.  As  discussed  in  the 
section  on  Organizational  Analysis,  report  screens  (along  with  the  data  entry  and 


Performance  Measures  - III  - 12 


City  and  County  of  San  Francisco  Department  of  Building  Inspection 

Performance  Audit 


computations  to  support  these)  should  allow  Customer  Service  staff  to  respond  directly  to 
these  inquiries,  without  the  need  to  contact  Plan  Check  professionals.  As  noted 
previously,  current  system  reporting  on  plan  check  status  is  also  of  limited  use  to 
management. 

The  type  of  data  currently  entered  in  daily  paper  logs  may  be  adequate  for  these  purposes 
with  minor  modifications,  e.g.  provision  of  Time  with  customer’  fields,  comment  codes 
explaining  delays,  and  estimates  of  expected  time  till  completion. 


KPMG 
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Organizational  Analysis 

Overview 

At  the  heart  of  any  service  organization  are  its  people.  Management  structures  and 
personnel  resources  combine  to  either  facilitate  or  impede  the  efficient  and  effective 
execution  of  an  organization’s  mission.  Our  approach  combines  an  organization-wide 
assessment  at  a high-level  with  more  targeted  analysis  specific  to  those  functions  that 
present  the  most  pressing  issues.  The  span  of  control  and  management  structure  analysis 
presents  a comprehensive  survey  from  the  perspective  of  the  entire  organization.  Our 
more  targeted  analysis  is  presented  in  the  discussions  of  staff  training  and  employee 
utilization.  These  issue  areas  are  further  outlined  below. 

Issues  Areas: 

■ Span  of  Control  and  Management  Structures 

■ Staff  Training  and  Accountability 

■ Employee  Utilization 

■ Customer  Service 

■ Code  Interpretation 

For  each  issue  area  we  present  and  discuss: 

■ Approach  and  Activities 

■ Observations  and  Findings 

■ Recommendations 


Span  of  Control  and  Management  Structures 

KPMG  performed  a span  of  control  analysis  of  the  various  organizational  structures  of 
the  CCSF  Department  of  Building  Inspection  over  the  past  three  year  period.  This 
analysis  reviewed  the  managerial  spans  of  control  from  the  Director  level  (Level  One) 
through  the  senior  inspector/senior  permit  clerk  level  (Level  Four).  This  portion  of  the 
report  contains  an  explanation  of  our  approach,  our  general  observations  by  management 
level,  a discussion  of  our  pertinent  findings,  and  our  associated  recommendations. 
Specifically,  this  section  is  organized  as  follows: 

■ Approach  and  Activities 

■ Observations 

■ Level  One  Management  - Director 

■ Level  Two  Management  - Deputy  Directors 

■ Level  Three  Management  - Division  Managers 

■ Level  Four  -Seniors 

■ Findings 

■ Recommendation 
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Approach  and  Activities 

KPMG  employs  the  span  of  control  diagnostic  technique  to  assist  us  in  gaining  a 
thorough  understanding  of  reporting  relationships  and  management  breadth  in  the  target 
organization.  In  simple  terms  the  span  of  control  analysis  graphically  depicts  the  range 
of  numbers  of  direct  reports  at  varying  levels  in  the  organization.  However,  when 
combined  with  other  pertinent  information  such  as  the  knowledge  gained  through  our 
personal  interviews  and  focus  group  activities,  this  analytical  tool  can  provide  true 
perspective  regarding  an  organization’s  potential  to  become  a more  balanced  and  cost 
effective  entity. 

Our  span  of  control  analysis  therefore  considers  many  factors  other  than  the  mere  number 
of  personnel  directly  reporting  to  a supervisor,  such  as;  the  similarity  of  department 
missions;  geographic  contiguity  of  people;  the  complexity  of  their  job  functions;  the 
direction,  control,  planning  and  coordination  required  to  fulfill  the  organizational 
purpose.  In  the  sections  below,  KPMG  outlines  the  current  span  of  control  in  the  4 
supervisory  levels  found  in  the  DBFs  current  organization.  We  cite  trends  and 
significant  changes  where  relevant  when  reviewing  the  DBFs  current  structure.  In  the 
final  section,  we  offer  some  recommendations  resulting  from  this  analysis  for  further 
consideration  by  the  DBI  leadership. 

In  the  course  of  this  analysis  KPMG  used  the  three  most  recent  DBI  organizational  charts 
dated  April  1999,  September  1998,  and  December  1996  as  well  as  background 
information  learned  during  Phase  Two  fieldwork.  The  ratios  reflected  in  the  figures  in 
this  section  account  for  all  designated  job  positions  including  those  labeled  as  vacant  in 
the  organizational  documentation. 


Observations:  Level  One  Management  - Director 

The  DBI  Director  currently  directly  supervises  three  positions;  the  Deputy  Directors  of 
Administration  and  Operations  and  a Special  Assistant.  (The  Special  Assistant  serves  as 
the  DBFs  principal  customer  outreach  representative.)  The  Director’s  direct  supervisory 
responsibilities  have  varied  over  the  period  of  analysis  from  a high  of  six  in  September  of 
1998  to  the  low  of  three  at  present  (Figure  IV- 1). 

In  the  course  of  our  fieldwork  the  Director  indicated  that  between  September  of  1998  and 
the  latest  reorganization  in  April  of  this  year,  he  was  particularly  concerned  about  the 
Administrative  and  Personnel  Services  sections  of  the  Department.  He  has  since  made 
some  changes  in  the  leadership  and  composition  of  these  divisions  and  recently  delegated 
supervisory  responsibility  to  his  Deputy  Director  for  Administration.  At  present,  the 
Director’s  special  emphasis  area  is  with  the  Customer  Service  and  Community  Outreach 
efforts  and  therefore  he  maintains  closer  personal  control  of  these  activities. 


w 
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Average  Span  of  Control  - Level  One 


Dec  1996  Sep  1998  April  1999 

Date  of  Organizational  Structure 


Figure  IV-1  Average  Span  of  Control  — Level  One 

The  Director  chooses  to  personally  supervise  troubled  divisions  or  areas  of  special 
emphasis  for  relatively  brief  periods  of  time  and  then  delegates  direct  responsibility  to  a 
principal  subordinate.  In  this  manner  he  does  not  burden  himself  with  additional  direct 
supervisory  responsibility  for  extended  time  periods  but  rather  only  when  such  extra 
emphasis  is  necessary.  This  is  clearly  a useful  technique  used  by  the  DBFs  senior 
executive  to  impart  clear  overall  standards  and  then  allow  the  activity  to  achieve  its 
mandate  independently. 

Observations:  Level  Two  Management  - Deputy  Directors 
The  current  DBI  organizational  structure  consists  of  two  deputy  directors  for 
Administration  and  Operations,  each  responsible  for  7 and  10  direct  reports  respectively 
(Figure  IV-2). 


Figure  IV-2  Span  of  Control  - Level  Two 
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The  current  DBI  organization  represents  a marked  change  from  its  previous  structure. 

The  current  organization  groups  all  support  functions  together  separating  them  fiom  most 
core  functional  processes  of  the  department;  inspections,  plan  checking  activities  and  the 
issuing  of  permits  (Central  Permit  Bureau  is  the  only  exception).  Prior  to  April  1999,  the 
principal  organizational  distinction  was  between  permit  and  inspection  activities  with  the 
permit  issuing  function  linked  exclusively  to  the  plan  check  function  (Table  IV- 1). 


Table  IV-1  - September  1998  Department  Organization 


Permit  Services  (Hutchinsen) 

Inspection  Services  (Wong) 

Central  Permit  Bureau 

Code  Enforcement/Disabled  Access 

Major  Project  Plan  Check 

Building  Inspection 

Commercial  Plan  Check 

Electrical  Inspection 

Residential  Plan  Check 

Housing  Inspection 

Mechanical  Plan  Check 

Plumbing  Inspection 

Technical  Services 

Special  Programs 

One  Stop  Permit 

Records  Management 

Management  Information  Systems 

This  change  in  structure  has  significantly  altered  the  direct  supervisory  responsibilities 
for  both  deputies  in  different  ways.  Specifically,  the  Deputy  Director  for  Administration 
presently  finds  himself  responsible  for  a variety  of  administrative  support  areas  while  the 
Deputy  Director  for  Operations  is  now  responsible  for  inspection  services  as  well  as  plan 
check  and  permit  activities. 

This  reorganization  poses  risks  in  both  deputates.  Although  the  current  span  of  control  in 
the  administrative  deputate  remains  the  same  as  of  September  1998  at  1:6,  the  diverse 
nature  of  component  activities  make  the  Deputy  Director  for  Administration  ‘s  current 
managerial  responsibilities  much  more  challenging.  For  now  instead  of  six  divisions 
with  four  of  the  six  being  “inspection-related”,  Mr.  Wong  has  responsibility  for  6 
divisions  each  with  a unique  mandate.  Mr.  Hutchinsen’s  number  of  direct  reports  in  the 
operational  deputate  have  increased  from  9 to  10  however  all  these  activities  are  either 
plan  check,  inspection  or  permit  related.  His  challenge  is  not  in  the  diversity  of  his 
subordinate  division  rather  the  high  number  of  separate  activities  (Figure  IV-3). 
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Average  Span  of  Control  - Deputy  Director  (Level  Two) 


Number  of 
Personnel 
Supervised 


□ Deputy  Director 
Administration/Inspections* 
■ Deputy  Director 
Operations/Permits* 


Dec  1996  Sep  1998  Apr  1999 

Date  of  Organizational  Structure 


*Prior  to  April  1999,  the  DBI’s  deputy  directors  were  in  charge  of  the  “ Inspections ” and  “Permits”  versus  the  current  distinction 
between  “Administration” and  “Operations”. 

Figure  IV -3  Average  Span  of  Control  - Level  Two 

Observations:  Level  Three  Management  - Division  Managers 
The  average  number  of  Level  Three  direct  reports  has  increased  by  1 .5  personnel  in  the 
Administrative  deputate  to  1:6.5  personnel  while  the  direct  reports  in  the  Operations 
deputate  has  decreased  from  1:8.8  in  December  1996  to  1:6.1  as  of  April  1999  (Figure 
IV-4).  (The  current  disposition  of  supervisory  responsibility  is  not  apparent  from  the 
DBFs  current  organizational  chart  as  it  does  not  reflect  Level  Four  supervisors  in  the 
Central  Permit  or  Code  Enforcement  Divisions.) 


Average  Span  of  Control  - Division  Managers 
(Level  Three) 

= ;|:  : 

E3  Administration/Inspections 
Directorate 
■ 0 perations/P  erm  its 
Directorate 

Dec  1996  Sep  1998  Apr  1999 

Date  of  Organizational 
Structure 

Figure  IV-4  Average  Span  of  Control  - Level  Three 
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Despite  this  statistical  similarity  in  Level  Three  spans  of  control,  there  is  actually  a 
marked  difference  across  the  components  divisions  within  the  deputates.  The  span  of 
control  responsibilities  within  the  DBI  at  this  level  vary  widely  from  a high  of  fourteen  in 
the  Major  Plan  Check  division  to  a low  of  two  in  the  Central  Permit  Bureau  (Figures  IV-5 
& 6).  The  average  disposition  of  division  manager  supervisory  responsibility  is  much 
narrower  in  the  Administrative  deputate  at  1:4.8.  In  Operations,  the  division  managers  on 
average  directly  supervise  6.1  employees  (Figure  IV-6). 


Span  of  Control  - Division  Managers  (Level  Three  - 
Administration) 
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■ Personnel  Services 
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■ Records  Mgmt 


Figure  IV-5  Span  of  Control  - Level  Three  (Administration) 


Span  of  Control  - Division  Managers 
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Operations  Division 

■ Commercial  Plan  Check 

■ Major  Project  Plan  Check 

Figure  IV-6  Span  of  Control  - Level  Three  (Operations) 
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Observations:  Level  Four  Management  -Seniors 

The  Level  Four  management  structure  has  remained  largely  the  same  during  the  period  of 
analysis;  specifically  since  most  Level  Four  supervisors  are  senior  inspectors  within  the 
inspection  divisions.  Since  1996,  the  number  of  persons  supervised  per  senior  inspector 
has  steadily  decreased  for  the  plumbing  and  electrical  divisions  where  it  has  steadily 
increased  for  building  and  housing  inspection  divisions  (Figure  IV-7).  When  combined 
with  the  DBFs  figures  for  the  number  of  inspections  conducted,  this  adjustment  in  line- 
level  inspectors  seems  logical.  (See  Section  in  on  Performance  Measurement.) 


Aveage  Span  of  Control  - Seniors  (Level  Four) 


Dec  1996  Sep  1998  Apr  1999 

Date  of  Organizational  Structure 


□ Plumbing  Inspection 

■ Electrical  Inspection 

□ Housing  Inspection 

□ Building  Inspection 

■ Central  Permit 
Bureau 

□ Code  Enforcement 
Division 


Figure  TV-7  Average  Span  of  Control  - Level  Four 


Findings 

As  the  observations  above  reveal,  a wide  variety  in  spans  of  control  exist  within  the  DBI. 

In  this  section,  KPMG  provides  key  points  on  several  items  of  interest. 

General: 

• KPMG's  Organizational  Model  for  Change,  Organizational  Assessment  Criteria 
suggests  a ratio  of  twelve  “staff’  per  every  manager. 

• In  1994,  the  National  Performance  review  recommended  that  the  Federal 
government  move  from  an  average  ratio  of  1:7.0  to  1:14.0. 

• Tom  Peters  author  of  Thriving  on  Chaos,  states  that  ‘well-performing  organizations 
should  operate  in  a range  of  25  to  75  workers  for  every  one  supervisor”. 

In  light  of  these  comparisons , collectively  the  DBI  falls  within  the  aforementioned 

guidelines.  Presently  the  manager  to  staff  ratio  within  the  entire  DBI  at  Levels  1-4  is 

1:5.9. 
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Middle  Level  Management.  The  City  of  Portland  established  a more  detailed  scale 
saying  that  middle  level  managers  are  to  have  a span  of  control  of  no  less  than  1:5.0  with 
administrative  supervisors  having  a span  of  control  of  1 :6.0  to  1 : 12.0. 

If  the  DBTs  Level  Three  division  managers  are  considered  “ middle  level 
management”,  again  the  Department  is  at  the  low  end  of  the  range,  for  the 
Administrative  deputate  the  span  of  control  average  ratio  is  1:4.8;  for  the  Operations 
deputate  the  span  of  control  average  is  1:6.1.  The  functional  diversity  of  the  divisions 
in  Administration  may  justify  a lower  manager/staff  ratio. 

Layers  of  Management: 

• Two  organizational  experts,  Robert  Tomasko  and  Tom  Peters,  believe  that  an 
organization  should  have  a maximum  of  five  management  layers. 

• KPMG  best  practice  standards  indicate  the  public  sector  organizations  should  have 
no  more  than  six  layers  of  management,  except  in  very  unique  circumstances 

The  DBI  lies  well  within  these  parameters  with  its  four  internal  management  levels. 

Considered  purely  on  statistical  ratios  alone,  the  DBFs  internal  spans  of  control  meet  or 
exceed  a variety  of  widely  accepted  evaluation  criteria.  But  instrumental  to  our  approach 
is  a consideration  of  other  factors  relevant  to  organizational  structure  such  as  the 
similarity  of  department  functions;  the  complexity  of  their  job  responsibilities;  the 
direction,  control,  planning  and  coordination  required  to  fulfill  the  organizational 
mission.  As  such  it  is  important  to  note  the  following: 

Plan  Check  functions:  The  DBFs  Plan  Check  divisions  each  operate  as  a separate 
division  although  each  of  the  four  has  the  same  basic  mission.  While  the  types  of  plans 
and  their  degrees  of  complexity  vary  widely,  the  basic  functions  of  the  four  divisions 
remain  the  same.  Given  the  tremendous  work  volume  coupled  with  the  significant 
supervisory  responsibility  in  the  Commercial  and  Major  Project  Plan  Check  divisions, 
(1:11  and  1:14  respectively),  this  condition  warrants  closer  examination.  Some 
consolidation  of  plan  check  functions  and/or  plan  review  responsibilities  between  the 
four  different  Plan  Check  divisions  may  relieve  some  of  the  burden  upon  the  present 
division  heads  as  well  as  the  Deputy  Director  for  Operations. 

Major  Project  Plan  Check:  The  1:14  supervisory  ratio  in  this  division  is  the 
highest  in  the  entire  Department.  Although  the  ratio  does  not  significantly  exceed  some 
span  of  control  guidelines,  the  demanding  supervisory  responsibility  coupled  with  the 
important  mission  of  the  Division  raises  at  the  very  least  concerns  about  its  effectiveness. 
This  situation  is  made  more  significant  because  the  projects  reviewed  by  this  division  are 
highly  visible  and  are  tracked  closely  by  a number  of  public  and  private  agencies  outside 
the  DBI. 
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Recommendation 

IV- 1.  Consider  the  addition  of  a single  supervisor  over  the  Department's  plan  check 
activities. 

The  similarity  of  the  function  seems  to  indicate  that  this  would  be  a logical  step  towards 
making  the  best  use  of  resources.  Such  an  arrangement  would  allow  another  mid-level 
supervisor  to  place  extra  emphasis  on  the  Plan  check  area  and  relieve  Mr.  Hutchinsen  of 
some  of  his  day-to-day  supervisory  responsibilities.  This  addition  could  help  clear  up  the 
backlog  and  improve  permit  issuing  times  within  the  DBI.  The  recommendation  requires 
much  additional  consideration  and  analysis. 


Staff  Training  and  Accountability 
Approach  and  Activities 

The  KPMG  project  team  examined  staff  training  and  accountability  within  the 
department  through  a series  interviews  and  two  targeted  survey  instruments.  These  steps 
were  designed  to  gain  an  understanding  of 

■ Methods  for  determining  and  delivering  training; 

■ Management  and  support  staff  attitudes  towards  training; 

■ Management  attitudes  towards  performance  measures  and  accountability,  and 

■ Support  staff  attitudes  towards  work  responsibilities  and  accountability. 

Training  and  accountability  issue  areas  were  identified  in  the  Phase  I Risk  Assessment. 
To  investigate  these  issues  further  we  did  the  following: 

■ Interviewed  the  Personnel,  Technical  Services  managers  in  Administration  and 
selected  Plan  Check  and  Inspections  managers  in  Operations; 

■ Reviewed  documentation  recording  training  requests,  fulfillment  and  payments  to 
training  vendors,  and 

■ Developed,  administered  and  analyzed  survey  instruments  soliciting  input  from 
two  employee  groups — administrative  support  and  mid-level  management— on 
training  and  accountability  issues. 

Observations  and  Findings 

Key  to  our  analysis  are  the  responses  to  the  two  survey  instruments.  We  developed  our 
findings  and  observations  from  these  survey  responses  in  conjunction  with  information 
gathered  from  the  interviews  and  document  review  noted  above.  Our  observations  and 
findings  are  discussed  below  as  follows: 

■ Survey  Distribution  and  Response  Patterns  - a comparison  of  surveys  distributed 
and  surveys  received  for  each  of  the  two  groups,  by  functional  area. 

■ Survey  Responses  - a discussion  of  the  survey  responses  received  from  each 
group,  and  our  observations  and  findings. 


KPMG 
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Survey  Distribution  and  Response  Patterns 

KPMG  distributed  administrative  and  management  surveys  to  a total  of  57  individuals 
across  various  functional  areas  of  responsibility.  Of  the  57  surveys  distributed,  40 
responses  were  received  for  an  overall  response  rate  of  70%.  Distribution  and  response 
patterns  for  administrative  and  management  surveys  are  discussed  separately,  below. 

Administrative  Support 

Administrative  surveys  were  distributed  to  support  personnel  in  the  Plan  Check  and 
Inspections  divisions,  and  to  operations  clerks  in  the  Central  Permit  and  One  Stop 
divisions  as  illustrated  (Figure  IV-8). 


Few  Responses  from  CPB  Staff  -Administrative  support  and  operations  clerical  staff 
were  less  responsive  to  the  survey  than  their  management  counterpart.  This  was 
especially  the  case  for  Central  Permit  Bureau  which  accounted  for  23%  of  the  surveys 
distributed  but  only  4%  of  the  responses  collected  (Figure  IV-9). 


Composition  of  Administrative  Staff  Survey 
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Figure  IV-8 


Administrative  Support  Staff 
Survey  Responses  by  Function 
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Figure  IV-9 


Organizational  Analysis  • IV  - 10 


City  and  County  of  San  Francisco  Department  of  Building  Inspection 
Performance  Audit 


Management 

Management  surveys  were  distributed  to  the  managers  and  seniors  in  the  Plan  Check  and 
Inspections  divisions  as  illustrated  (Figure  IV- 10). 


Composition  of  Management  Survey 
Distribution 


[SPIan  Check  * Inspections  [ 

Figure  IV- 10 


High  Management  Response  Rate  - Management  survey  responses  closely  mirrored  the 
distribution  pattern  with  a virtually  identical  numbers  from  each  function  responding 
(Figure  IV- 11). 


Management 

Survey  Responses  by  Function 
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Figure  IV-11 
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Survey  Responses 

Administrative  Staff 

KPMG  developed  a questionnaire  to  assist  us  in  gauging  staff  training  and  accountability 
across  the  DBI.  Administrative  staff  members  in  the  four  functional  areas  were  asked  to 
respond  to  a series  of  eight  questions.  Responses  for  each  question  are  summarized 
below  (Table  IV-2). 


Table  IV-2  - Administrative  Survey  Responses 


Question 

Strongly 

Disagree 

Disagree 

No 

Opinion 

Agree 

Strongly 

Agree 

1 . I have  sufficient  time  and  resources  to 
accomplish  all  the  work  I am  responsible 
for. 

0% 

38% 

8% 

50% 

0% 

2.  My  work  responsibilities  are  clearly 
defined. 

0% 

13% 

8% 

67% 

8% 

3.  Work  responsibilities  for  other 

administrative  staff  in  my  unit  are  clearly 
defined. 

0% 

13% 

25% 

58% 

0% 

4.  I have  been  provided  with  sufficient  training 
to  perform  my  job. 

0% 

17% 

13% 

63% 

4% 

5.  I could  benefit  from  further  training  to 
improve  my  job  skills. 

0% 

4% 

8% 

46% 

38% 

6.  My  job  duties  are  a good  match  for  my  job 
skills. 

4% 

13% 

8% 

58% 

13% 

7.  My  supervisor  ensures  workload  is 
distributed  fairly  among  administrative 
support  in  my  work  unit. 

5% 

8% 

21% 

62% 

0% 

8.  Professional  staff  (inspectors,  plan 

checkers)  appreciate  and  value  the  work  of 
administrative  support  staff  in  my  unit. 

0% 

8% 

17% 

50% 

21% 

Overall  Survey  Responses  Positive  - Overall,  administrative  staff  expressed  positive 
opinions  on  work,  training,  and  management,  with  a high  number  of  positive  responses  to 
all  questions  (Figure  IV- 12). 
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Figure  IV- 12  — Administrative  Survey  Responses 


Organizational  Analysis  - IV  - 12 


City  and  County  of  San  Francisco  Department  of  Building  Inspection 
Performance  Audit 


In  reviewing  the  comments  and  responses  submitted  by  Administrative  Support  Staff, 
several  major  themes  were  evident.  Analysis  of  the  response  data  by  KPMG  revealed  the 
following  themes.  In  general,  administrative  staff: 

■ View  workloads,  responsibilities  and  skill  levels  positively  despite  significant 
perceptions  of  inadequate  time  and  resources; 

■ Believe  training  could  improve  their  job  skills  and  performance,  and 

■ Express  discontent  with  the  current  promotion  system. 

Positive  Responses  Overall  - Responses  with  respect  to  workload  and  responsibilities 
were  positive  overall,  with  administrative  staff  agreeing  significantly  that: 

■ Responsibilities  are  clearly  defined; 

■ Job  duties  assigned  are  appropriate  to  staff  skills; 

■ Workloads  are  distributed  fairly,  and 

■ Professional  staff  value  the  work  performed  by  administrative  and  clerical  staff. 

Substantial  Minority  View  Time  and  Resources  as  Inadequate  - Overall,  50%  of  the 

employees  responding  agreed  that  they  had  enough  time  and  resources  to  perform  their 
workloads.  However,  38%  of  the  administrative  staff  disagreed  and  12%  had  no  opinion. 
KPMG  noted  that  of  the  38%  that  disagreed,  responses  were  evenly  distributed  among 
Plan  Check,  Inspection,  One-Stop  and  Central  Permit  Bureau  staff. 

As  noted  in  the  section  Business  Process  Analysis,  interviews  and  observations 
conducted  with  administrative  staff  from  the  various  functions  revealed  a high  number  of 
manually  intensive  processes.  Furthermore,  with  the  staged  implementation  of  Oracle 
based  applications  not  yet  completed,  the  degree  of  manual  processes  varies  widely 
among  administrative  staff.  These  time  intensive  processes  combined  with  the  additional 
responsibilities  may  provide  a partial  explanation  for  staff  perceptions  that  the  time  and 
resources  available  are  inadequate  to  perform  their  job  duties. 

High  Demands  for  Additional  Training  - In  general,  most  employees  believed  that  they 
had  received  sufficient  training  to  perform  their  job  duties.  However,  approximately  85% 
believed  that  additional  training  would  improve  their  job  skills  and  work  performance.  In 
support  of  this  perception,  KPMG  noted  that  many  of  the  administrative  staff  members 
lacked  familiarity  or  skill  in  using  software  and  technology  applications. 

Indications  of  Dissatisfaction  with  Hiring  and  Promotions  - In  addition,  several 
comments  indicated  discontent  with  current  hiring  and  promotion  practices.  Specifically, 
staff  commented  that  management  philosophy  should  focus  more  on  promoting  from 
within.  Currently,  staff  believe  most  new  employees  are  sought  from  outside  the 
organization. 

Although  most  employees  agreed  that  their  workloads  were  distributed  fairly,  a 
significant  minority,  approximately  38%,  provided  responses  of  either  disagree,  strongly 
disagree  or  no  opinion.  Several  employees  cited  strong  preferential  treatment  by 
managers  in  the  distribution  of  workloads  and  hiring  of  family  and  friends. 


KPMG 
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Management 

All  division  level  managers  were  asked  to  respond  to  a series  of  10  questions.  Responses 
for  each  question  are  summarized  below  (Table  IV-3). 


Table  IV -3  - Management  Survey  Responses 


Question 

Strongly 

Disagree 

Disagree 

No 

Opinion 

Agree 

Strongly 

Agree 

1 . In  general,  performance  measures  (MBOs)  are 
a useful  tool  in  managing  staff  workloads. 

0% 

6% 

13% 

69% 

6% 

2.  In  general,  performance  measures  (MBOs)  are 
a useful  tool  to  ensure  individual 
accountability. 

0% 

13% 

0% 

75% 

6% 

3.  The  performance  measures  (MBOs)  used 
currently  for  my  division  are  appropriate 
indicators  of  staff  efficiency  and  effectiveness. 

0% 

13% 

6% 

75% 

0% 

4.  I view  the  performance  measures  (MBOs) 
used  currently  for  my  division  as  an  important 
management  tool. 

0% 

6% 

19% 

63% 

6% 

5.  The  MBO  goals  for  my  division  are 
reasonable  and  do  not  need  adjustment. 

0% 

25% 

0% 

69% 

0% 

6.  The  MBO  goals  for  my  division  are  too  high 
and  should  be  lowered. 

0% 

50% 

25% 

13% 

6% 

7.  The  current  request  - driven  system  is 

sufficient  to  ensure  adequate  training  of  staff 
in  my  unit. 

0% 

19% 

25% 

50% 

0% 

8.  State-mandated  courses  for  new  and 
continuing  employees  provide  adequate 
knowledge  for  staff  to  perform  most  job 
duties. 

0% 

44% 

19% 

31% 

0% 

9.  Training  for  managers  and  supervisors  is 
valuable  and  the  current  amount  of  such 
training  is  adequate. 

0% 

25% 

19% 

50% 

0% 

10.  Technical  Services  serves  as  a valuable 
resource  for  identifying  sources  of  outside 
training. 

0% 

25% 

31% 

31% 

6% 

ME 
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MBOs  Accepted  but  Training  Viewed  as  Inadequate  - As  indicated  by  the  graph 
below,  survey  responses  varied  markedly  by  topic.  Questions  1-5  on  MBO  performance 
measures  received  highly  favorable  responses  while  responses  to  Questions  6-10  on 
training  were  negative.  Specifically: 

■ Most  mid-level  managers  accept  MBO  performance  measures. 

■ Most  managers  view  training  as  inadequate  and  hard  to  access. 


Figure  IV- 13  on  the  following  page  illustrates  the  composition  of  management  survey 
responses. 
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Figure  IV-13  - Management  Survey  Responses 


MBOs  Viewed  as  Valid  Management  Tool  - In  evaluating  survey  results  from  the 
inspectors,  plan  checkers  and  management,  approximately  75%  said  that  MBO 
performance  measures  were: 

■ Useful  in  managing  staff  workloads; 

■ Ensured  individual  worker  accountability; 

■ Appropriate  indicators  of  efficiency,  and 

■ Reasonable. 

Although  MBO  acceptance  appears  high,  some  respondents  commented  that  the 
inspections  per  inspector  per  day  measure  effected  the  quality  of  the  inspection,  noting 
that  inspectors  feel  pressured  to  meet  their  daily  goals  and  may  perform  a less  than 
thorough  inspection. 

In  the  Plan  Check  divisions,  managers  commented  that  workloads  are  high  and  resources 
are  inadequate  for  the  performance  of  high  quality  plan  reviews  with  the  additional 
demands  of  responding  to  numerous  customer  phone  calls  and  meeting  with  customers  to 
answer  inquiries. 
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Negative  Comments  on  Value,  Adequacy  of  Training  - In  general,  most  staff  and 
management  commented  that  training  received  was  not  adequate  or  valuable. 
Specifically,  those  who  commented  felt  that  state  mandated  courses  did  not  provide 
adequate  knowledge  to  perform  most  job  duties.  Although,  50%  of  the  surveys  indicated 
that  the  amount  of  training  was  adequate,  the  remaining  50%  either  disagreed  or  had  no 
opinion. 

Views  on  Current  Access  to  Training,  Role  of  Technical  Services  Mixed  - Based  on 
the  responses  obtained,  it  appears  that  access  to  training  may  be  difficult  given  the 
current  processes  in  place.  When  asked  if  the  current  request  system  is  sufficient  to 
ensure  training,  only  50%  agreed.  The  remainder  either  disagreed  or  had  no  opinion. 
Also,  of  the  surveys  received,  25%  disagreed  and  37%  had  no  opinion  when  asked  if  the 
Technical  Services  division  serves  as  a valuable  resource  for  identifying  outside  training. 
The  fact  that  37%  of  the  surveys  indicated  no  opinion  suggests  that  those  individuals 
have  never  utilized  technical  services  or  were  not  aware  that  they  provided  that  function. 


Recommendations 
Administrative  Staff 

IV-2.  Central  Permit  Bureau  staff  should  also  be  trained  on  the  efficient  usage  of 
automation  and  technology  already  available . 

Workload  demands  in  the  Central  Permit  Bureau  directly  affect  customer  wait  times  and 
satisfaction  with  service.  Indications  that  a substantial  minority  view  workloads  as 
excessive  and  desire  additional  training,  combined  with  KPMG’s  project  team 
observations,  support  the  need  for  better  availability  and  use  of  automated  tools  to 
streamline  work  processes. 

Management  Staff 

IV- 3.  The  Department  should  re-examine  its  current  request-driven  system  for 
addressing  training  needs,  take  a more  proactive  approach  with  managers  to  identify 
specific  training  needs  of  professional  staff  members,  and  develop  periodic  and 
refresher  training  requirements. 

Survey  responses  indicate  management  concerns  about  the  current  state  of  training  are 
significant.  A substantial  minority  expressed  concerns  about  the  current  request-driven 
system  and  is  unaware  of  the  role  of  the  Technical  Services  division  in  identifying  and 
suggesting  appropriate  coursework.  A more  structured  approach  to  training  would 
supplement  state-mandated  courses  clearly  seen  as  inadequate  with  training  more 
responsive  to  recognized  needs. 
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Employee  Utilization 
Customer  Service 
Approach  and  Activities 

As  the  first  contact  most  customers  have  with  the  Department,  Customer  Service  staff 
members  are  in  a unique  position  to  assist  the  efficient  and  effective  routing  of  customers 
towards  the  services  they  seek.  From  the  customer’s  viewpoint,  efficiency  in  customer 
service  is  measured  by  the  speed  with  which  customer  inquiries  are  “resolved”, 
effectiveness  by  the  quality  of  the  “resolution”. 

Such  a perception  of  customer  service  is,  however,  incomplete.  Specifically,  such  a 
perception  does  not  acknowledge  the  role  Customer  Service  staff  plays  in  contributing  to 
the  efficiency  and  effectiveness  of  other  units  within  the  Department.  Customers 
misdirected  to  other  divisions  add  to  the  workloads  of  already  busy  operational  staff  in 
the  Inspections,  Plan  Check  and  One  Stop  and  Central  Permit  divisions. 

In  the  course  of  our  Phase  II  research,  the  KPMG  project  team  identified  several 
indicators  that  the  Customer  Service  function  did  indeed  affect  the  efficiency  and 
effectiveness  of  other  Department  units.  These  are  detailed  in  the  findings  below.  Based 
on  these  indications,  KPMG  concluded  that  additional  analysis  of  Customer  Service  staff 
roles  and  responsibilities  was  needed.  This  included: 

■ Interviews  of  Customer  Service  staff  at  two  of  the  three  service  desks; 

■ Observation  of  staff  interactions  on  the  phone  and  in  person  with  customers  at 
these  same  posts,  and 

■ Examination  of  staff  usage  of  automated  system  reference  tools  available  to 
answer  customer  inquiries. 

Observations  and  Findings 

Top  Management  Has  Made  Serving  the  Customer  a Priority  - Interviews  at  various 
staff  levels,  as  well  as  operational  observation,  have  made  clear  that  serving  the  customer 
is  a well-established  priority  throughout  the  Department.  From  the  Director  to  the  line 
employee,  customer  service  is  emphasized  as  the  organization’s  top  priority.  Many 
recent  initiatives  reflect  this  including  the  opening  of  an  express  window  and  expansion 
of  the  One  Stop  program.  The  foundation  for  a successful  implementation  of  many  of 
KPMG’s  recommendations  to  improve  service  to  the  customer  is  already  apparent. 

Customer  Service  Staff  are  Dedicated  and  Courteous  - During  the  course  of 
observing  the  delivery  and  processes  associated  with  customer  service,  KPMG  noted  the 
dedication,  courtesy  and  eagerness  with  which  staff  assisted  customers.  Those  staff  at  the 
information  desk,  the  first  point  of  contact  for  walk-in  customers,  exhibited  particular 
skill  in  handling  a large  numbers  of  sometime  impatient  customers  as  well  as  incoming 
phone  calls. 
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Incoming  Phone  Calls  Occupy  Most  of  Customer  Service  Staff  Time  - Our  sample 
observations  indicated  that  answering  customer  phone  inquiries  occupied  approximately 
80%  of  time  of  three  full  time  staff  equivalents.  The  remaining  time  is  dedicated  to 
responding  to  the  questions  of  walk-in  customers.  According  to  our  observations,  call 
volumes  are  not  evenly  distributed  among  the  three  Customer  Service  stations. 

KPMG  observed  that  calls  are  initially  received  by  the  main  call  center  on  the  sixth  floor 
of  the  Department.  As  calls  are  ‘backlogged,’  they  are  rolled  forward  to  staff  at  two  other 
Customer  Service  stations  as  illustrated  (Figure  IV- 14). 


As  phone  calls  become  backlogged 
at  the  main  call  center,  additional 
calls  are  automatically  routed  to  the 
next  station. 


When  phone  calls  become  backlogged  at 
the  second  station,  the  overflow  is  routed 
to  the  first  floor  representative.  This 
individual  then  becomes  responsible  for 
directing  walk-in  customers  and 
answering  telephonic  inquiries. 


Figure  IV-14  - Customer  Service  Call  Routing 
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High  Volume  of  Calls  with  Similar  Inquiries  - Based  on  both  observation  and 
interviews  of  Customer  Service  staff  members,  KPMG  estimates  that  approximately  75- 
85%  of  the  phone  calls  relate  to  a single  topic  — plan  status  in  the  plan  check  process. 
The  figure  below  depicts  the  estimated  proportion  of  overall  Customer  Service  staff  time 
dedicated  to  these  inquiries  (Figure  IV- 15). 


Primary  Customer  Service  Functions 


Figure  IV-15  - Primary  Customer  Service  Functions 


This  process  creates  additional  workload  for  administrative  clerks  and  plan  checkers 
within  the  divisions.  This  condition  is  reflected  in  the  comments  of  several  members  of 
these  divisions. 


Inability  to  Capture  Key  Data  on  Phone  Call  Volumes  - Data  on  phone  call  volumes 
provides  an  important  tool  for  management  decisions  on  how  to  best  utilize  Customer 
Service  and  professional  staff  to  resolve  customer  inquiries.  Existing  manual  processes 
are  of  limited  use  in  capturing  volume  and  performance  information.  Other  critical 
information  that  cannot  be  captured  and  analyzed  includes: 

■ Initial  telephone  wait  times; 

■ Telephone  wait  times  after  transfer; 

■ Volumes  of  calls  routed  to  particular  divisions, 

■ Repeat  calls  from  the  same  customer  with  the  identical  inquiry,  and 

■ Customer  inquiry  trends. 

The  Department’s  own  attempt  to  gather  specific  call  volume  information  manually  has 
proven  difficult.  Indications  exist  that  the  call  volume  per  month  recorded 
underestimates  the  actual  number  of  incoming  calls.  Currently,  phone  calls  are  manually 
logged  on  sheets  of  paper  and  tallied  at  the  end  of  the  day.  Although  Customer  Service 
representatives  are  diligent  in  this  effort,  the  tendency  to  omit  the  logging  of  calls 
increases  as  incoming  call  and  walk-in  customer  volumes  increase  staff  workloads. 
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A critical  indicator  of  how  well  service  is  delivered  to  the  customer  via  the  telephone  is 
“wait  time”.  No  reliable  estimates  exist  as  to  current  average  wait  times  although 
Customer  Service  staff  estimates  range  from  3-5  minutes,  if  workload  is  average,  and  up 
to  10  minutes,  when  the  number  of  backlogged  phone  calls  is  high.  Monitoring  customer 
wait  times  and  statistics  on  call  content  is  critical  to  developing  sound  strategies  for 
improving  customer  service. 

Inefficient  Routing  of  Calls  Cited  Across  Department  - Based  on  interviews  with  staff 
and  personnel  at  various  levels  across  multiple  divisions,  there  is  a general  concern  with 
the  routing  of  incoming  phone  calls  by  Customer  Service  staff.  Many  employees  stated 
that  they  consistently  receive  phone  calls  that  either  should  have  been  routed  to  another 
department  or  responded  to  by  the  customer  service  staff.  One  interviewee  indicated  that 
as  many  as  a third  of  the  phone  calls  received  could  be  answered  by  Customer  Service 
staff.  Another  suggested  the  establishment  of  ‘quiet  hours’  for  Plan  Check  professionals 
to  limit  the  disruption  to  work  flow  from  incoming  phone  calls.  However,  the 
Department  currently  has  no  means  to  accurately  assess  the  following: 

■ The  number  of  phone  calls  resolved  by  customer  service  versus  the  number  routed 
to  Department  operations  staff; 

■ Which  Plan  Check  or  Inspection  divisions  receive  the  highest  number  of  routed 
phone  calls,  and  the  time  spent  responding  to  these,  and 

■ The  average  time  required  per  phone  call. 

Reliable  information  on  these  and  other  measures  of  call  volumes  and  compositions  are 
necessary  to  develop  a sound  strategy  to  best  employ  Customer  Service  staff  and  relieve 
operations  staff  of  the  necessity  of  responding  to  excessive  numbers  of  calls. 


Recommendations 

IV -4:  Continue  the  current  strong  leadership  from  top  management  emphasizing 
customer  service  as  a priority  throughout  the  Department. 

Since  the  Department’s  separation  from  the  Department  of  Public  Works,  senior 
management  has  supported  several  initiatives  to  improve  customer  service  and  created  a 
sound  customer  service  culture  within  the  organization.  This  organizational  ethic  will 
serve  the  Department  well  as  it  moves  forward  to  implement  many  of  the 
recommendations  in  this  report. 

IV-5:  The  Department  should  move  to  implement  an  interactive  voice  response  (IVR) 
system  as  a first  step  to  collecting  call  volume  information  necessary  to  planning  a 
sound  strategy  to  lessen  Customer  Service  workloads,  operational  staff  distractions  and 
ensure  a more  effective  utilization  of  resources  organization-wide. 
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Based  on  an  analysis  of  call  volume  information  collected,  the  Department  could  shape 
the  IVR  to  system  could  handle  the  most  common  inquiries  by  allowing  most  customers 
to: 

■ Reserve  inspection  appointment  times  without  Inspection  clerical  assistance; 

■ Check  status  and  time  to  completion  of  plans  in  the  plan  review  process  without 
Customer  Service  or  Plan  Check  staff  assistance  (This  would  require  an  interface 
with  the  Oracle  system  and  require  modifications/additions  to  plan  check  status 
information  as  discussed  in  the  section  on  performance  measures.),  and 

■ Access  technical  code  interpretation  staff  directly  without  Customer  Service  staff 
assistance. 

Workloads  for  Inspection  division  clerks,  Plan  Check  division  professionals  and  the 
Customer  Service  staff  would  decrease,  allowing  the  Department  to  re-allocate  staff  to 
permitting  or  other  functions  and  increasing  available  time  for  plan  review  duties. 

Code  Interpretation 

Activities  and  Approach 

Within  the  City  and  County  of  San  Francisco,  the  Department  is  the  deciding  authority  on 
questions  of  code  interpretation.  New  code  rulings  from  the  State  must  be  codified  into 
San  Francisco  law  and  the  specifics  of  their  implementation  in  practice  decided.  Many 
customer  inquiries  concern  the  interpretation  of  codes,  and  whether  certain  construction 
methods  are  permissible  under  specific  articles  of  the  code.  Based  on  the  answers  to 
these  inquiries,  developers,  designers  and  architects  modify  plans  for  construction  to 
ensure  their  smooth  passage  through  the  plan  check  process. 

Staff  time  is  required  to  both  respond  to  the  numerous  code  interpretation  questions,  and 
develop  specific  interpretations  of  new  code  rulings.  To  gain  an  understanding  of  these 
processes  and  the  time  involved,  KPMG  performed  the  following: 

■ Interviewed  Technical  Services  management  on  code  interpretation  activities; 

■ Prepared,  administered  and  analyzed  an  activity  matrix  diagnostic  tool  to 
select  Plan  Check  staff  to  identify  work  activities  and  associated  time 
required; 

■ Analyzed  activity  matrix  responses,  and 

■ Conducted  additional  inquiries  with  Plan  Check  staff  to  determine  code 
interpretation  activities  in  greater  detail. 

From  these  activities,  KPMG  developed  a composite  picture  of  code  interpretation  duties, 
and  staff  roles  and  responsibilities. 

Observations  and  Findings 

Responses  to  Code  Interpretation  Inquiries  Lack  Consistency  - Currently,  two 
different  staff  groups  are  charged  with  the  responsibility  of  answering  code  interpretation 
inquiries: 
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■ A dedicated  staff  member  from  the  Technical  Services  division,  and 

■ Plan  Check  professionals  staffing  counters  or  responding  to  phones  as  part  of 
their  daily  duties. 

Along  with  its  other  responsibilities,  the  Technical  Services  division  documents  changes 
to  the  City  and  County’s  construction  codes  and  represents  the  Department  at  public 
forums  on  code  issues.  Plan  Check  professionals  responding  to  code  interpretation 
inquiries  are  the  same  staff  members  charged  with  reviewing  and  approving  construction 
plans  for  permit  issuance. 

Several  comments  from  focus  group  participants  and  individual  interviewees  indicate  that 
code  interpretation  responses  given  by  these  two  groups  often  differ.  (However,  our 
review  found  no  documentation  available  to  substantiate  the  frequency  of  this  condition.) 
While  Plan  Check  staff  base  their  answers  on  ongoing  experience  with  plan  reviews  and 
consensus  opinion  among  other  plan  reviewers  on  code  issues,  Technical  Services 
personnel  draw  from  a more  academic  knowledge  of  the  code. 

The  result  can  be  contradictory  responses  to  the  same  code  question.  This  condition 
contributes  to  customer  confusion  and  impatience.  Plans  submitted  in  accordance  with 
one  code  interpretation  may  be  rejected  because  of  a conflicting  interpretation  of  the  code 
used  by  the  actual  plan  reviewer. 

Code  Interpretation  Inquiries  Detract  from  Overall  Plan  Review  Time  - As  part  of 
its  analysis,  KPMG  asked  several  members  of  the  Plan  Check  staff  to  list  typical  work 
duties  and  the  times  required  for  each.  The  results  of  this  exercise  are  shown  in  Table 
IV -4  below. 


Table  IV-4  - Time  Spent  Responding  to  Code  Interpretation  Inquiries 


Staff  Member 

Daily  Time  Spent  (Hours) 

Monthly  Time  Spent  (Hours) 

J 

0.5 

10 

2 

1.0 

20 

3 

0.8 

16 

4 

0.5 

10 

AVERAGE 

0.7 

14 

Average  X 

23  hours 

462  hours 

33  Staff  Members 

per  day 

per  month 

FTE 

Average:  3 FTE 
Low:  2 FTE  - High:  4 FTE 

As  shown  above,  Plan  Check  staff  spend  several  hours  a day  answering  general  code 
interpretation  questions.  Several  Plan  Check  professionals  noted  that  the  distractions  of 
customer  inquiries  interfere  with  the  progress  of  plan  review  duties.  If  plans  are  complex. 


sob 
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such  interruptions  can  derail  the  train  of  thought  and  cause  delays  far  beyond  the  actual 
time  spent  responding  to  the  inquiry. 

Currently,  the  Technical  Services  division  has  one  dedicated  staff  member  assigned  to 
answering  code  interpretation  questions  and  responds  to  an  estimated  60-70  calls  per  day. 
Like  his  counterparts  within  the  Technical  Services  division,  this  staff  member  does  not 
review  plans.  One  additional  member  of  the  Commercial  Plan  Check  division  staff  is 
also  dedicated,  in  part,  to  answering  general  code  interpretation  questions. 

Recommendations 

IV-6.  Eliminate  conflicts  in  code  interpretation  provided  to  the  public  between  the 
Technical  Services  and  Plan  Check  professional  staff  by  establishing  periodic  forum  to 
identify,  discuss,  and  resolve  code  interpretation  issues. 

Conflicting  code  interpretations  provided  to  Department  customers  are  a cause  of 
frustration  for  both  Plan  Check  professional  staff  and  the  customer.  Plan  Check  staff  face 
the  unpleasant  task  of  informing  the  customer  that  the  interpretation  provided  was  not 
reflective  of  plan  check  practices,  and  the  customer  must  take  steps  to  revise  the  plans  to 
comply  with  the  ‘new’  interpretation.  Formalized  procedures  to  ensure  uniformity  in 
code  interpretation  information  provided  to  the  public  could  prevent  such  situations. 

IV-7.  Consider  employing  an  additional  Technical  Services  staff  member  to  answer 
general  code  inquiries  during  peak  periods  to  lessen  the  demands  on  Plan  Check 
professional  staff. 

Once  a mechanism  to  ensure  uniformity  of  code  interpretation  advice  is  in  place,  primary 
responsibility  for  responding  to  code  interpretation  questions  should  shift  to  non-  Plan 
Check  staff.  Fewer  interruptions  and  more  time  available  should  allow  Plan  Check 
professionals  to  increase  the  overall  number  of  plans  reviewed. 
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Focused  Expenditure  Review 

Overview: 

At  the  request  of  the  Office  of  the  Controller,  KPMG  conducted  a focused  review  of 
funds  allocated  for  the  purchase  of  laptop  computers  by  the  Department  of  Building 
Inspection.  Our  objective  was  to  determine  the  disposition  of  these  funds  assess  the 
usage  requirements  for  this  expenditure  and  ascertain  the  current  location  and 
employment  of  these  laptops. 

Approach  and  Activities 

KPMG  performed  the  following  with  regard  to  the  laptop  authorization  for  FY  96-97: 

■ Conducted  interviews  with  the  DBI  Administrative  and  Finance  Manager  and 
associated  staff  to  obtain  background  information  on  this  computer  purchase; 

■ Obtained  purchase  requisitions,  purchase  orders,  invoices,  voucher  posting 
and  a listing  of  the  current  locations  and  utilization  of  the  laptops  prepared  by 
DBI,  and 

■ Conducted  a limited  random  inventory  of  the  machines.  KPMG  verified  the 
existence  of  each  item  by  corresponding  serial  number  and  noted  its  current 
usage.  Table  V-l  below  displays  the  results  of  this  inventory. 


Table  V-l  - Listing  of  Laptop  Computers  Selected  for  Verification  Check 


Computer 

Serial  Number 

Assignee 

Use 

HP  Omnibook 

SG64300844 

W.  Wong 

Used  as  a desktop  computer 

HP  Omnibook 

SG64300846 

Y.  Chiu 

Used  as  a desktop  computer 

HP  Omnibook 

SG64300861 

D.  Duffy 

Used  as  a desktop  computer 

HP  Omnibook 

SG64300764 

R.  Birmingham 

Used  as  a desktop  computer 

HP  Omnibook 

SG64300827 

J.  Lee 

Used  as  a desktop  computer 

HP  Omnibook 

SG73610548 

J.  Miyamoto 

Used  as  a desktop  computer 

Findings  and  Analysis: 

According  to  interviewees,  the  laptops  were  originally  purchased  as  part  of  an  effort  to 
automate  inspection  processes.  Laptops  were  originally  intended  to  allow  inspectors  to 
download  information  from  the  DBFs  Oracle  database  remotely  and  provide  customers 
with  required  permit/inspection  paperwork  while  on-site. 

An  initial  operational  test,  however,  revealed  limits  to  the  practical  application  of  this 
plan.  Specifically,  inspectors  required  over  two  hours  to  download  the  required  database 
information  remotely  using  the  laptops. 


a, S' 
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Finding 

Based  on  documentation  provided  by  the  client , the  DBI  received  $284,400  in  budget 
appropriations  for  fiscal  year  96/97  to  purchase  the  equipment  listed  in  Table  V -2 
below: 


Table  V-2  - Laptop  Computer  Appropriation 


Item  Description 

Unit  Cost 

Number  of  Units 

Laptop  Computer 

$5,850 

40 

Software  Upgrade 

$450 

40 

Portable  Printer 

$360 

40 

Radio  Base  Station 

$18,000 

1 

Of  the  40  computers  appropriated,  based  on  documentation  received,  only  33  were 
purchased.  These  purchases  were  recorded  in  the  four  purchase  orders  shown  in  Table 
V-3  below: 


Table  V-3  - Laptop  Purchase  Orders 


P.O.  Number 

Request 

P.O.  Total  Price 

Unit  Price 

POBI97-23 

1 1 Toshiba  laptops 

$88,489*** 

$5,165 

POBI97-50 

20  HP  Omnibooks 

$111,380 

$5,569 

POBI98-11 

1 HP  Omnibook 

$4,034 

$4,034 

POBI98-14 

1 Toshiba  510CDT 

$5,812 

$5,812 

***  This  amount  included  the  purchase  of  other  items,  including  other  equipment  and  peri 

pherals.  Total  purchases  for 

the  four  purchase  orders  listed  is  $193,143. 


Note:  Purchase  requisitions  and  purchase  orders  reviewed  by  KPMG  appeared  to  be  reasonable.  In 
addition,  it  appears  that  the  unit  prices  of  the  computers  purchased  did  not  exceed  budgeted  unit  prices. 


Vendors’  invoices  recorded  the  actual  transfer  of  the  laptops.  KPMG  reviewed  the 
invoices  and  noted  that  the  amounts  reconciled  to  the  purchase  order  without  material 
exceptions.  In  addition,  KPMG  reviewed  the  prepared  voucher  posting  noting  that  the 
entry  appeared  reasonable. 

Finding 

In  reviewing  the  laptop  invoices  KPMG  noted  the  Department  purchased  several  items 
for  use  in  conjunction  with  the  laptops. 

As  shown  in  Table  V - 4 on  the  following  page,  several  pieces  of  accessory  equipment 
for  use  with  the  computers  were  purchased  with  the  funds. 
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Table  V-4  - Accessory  Items  Purchased  with  Appropriated  Funds 


Invoice  Number 

Reference  Number 

Issue 

889102 

POBI97-23 

The  following  items  were  included  in  the 
purchase.  These  were  separate  budgeted  items: 

1 1 VGA  17’  monitors  @ $8,979 
3 LEX  Laser  Printers  @ $10,452 
3 Duplexer  Printers  @ $1,351 

POBI98-14 

Toshiba  510CDT 

This  laptop  was  included  in  the  supporting 
documentation  but  not  on  the  laptop  listing. 

Finding 

Based  on  the  client-prepared  laptop  listing , KPMG  noted  that , of  the  33  laptops 
purchased,  one  was  currently  being  repaired  and  the  remainder  was  being  used  for  the 
various  functions  as  shown  in  Figure  V-l  below: 

Use  of  Laptop  by  Division 


1 9%0ther 
divisions 


49%  Bldg. 
Insp. 


16%  Admin. 

.6%  MIS 


; B Administration  B MIS 

i □ Permit  □ Building  Inspections  \ 

\ B Other  divisions 


Figure  V-l  - Current  Laptop  Utilization 

The  purchased  laptop  computers  were  re-distributed  to  various  divisions  within  the  DBI 
after  remote  use  for  inspections  proved  to  be  impractical.  Further  detail  on  current  usage 
is  provided  below: 

■ The  Building  Inspection  division  staff  use  49%  of  the  laptops.  Based  on  an 
interview  with  MIS  personnel  and  physical  observation,  these  laptops  are  now 
used  as  desktop  computers.  The  inspectors  conduct  their  work  in  the  field  and 
create  reports  and  track  information  from  the  office. 
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■ Administration  and  senior  management  use  1 6%  of  the  laptops  in  addition  to 
their  office  desktops.  The  laptops  are  reportedly  used  outside  the  Department 
to  perform  DBI-related  tasks. 

■ Permit  staff  use  1 0%  of  the  laptops  in  addition  to  their  desktops.  These 
laptops  reportedly  remain  at  their  residences,  due  to  the  nature  of  their  job 
responsibilities  and  hours  of  this  work  is  performed. 

■ MIS  personnel  utilize  6%  of  the  laptops. 

■ Finally,  19%  of  the  laptops  are  utilized  by  other  divisions  either  as  desktops  or 
in  addition  to  existing  office  computers. 
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CITY  & COUNTY  OF  SAN  FRANCISCO 
DEPARTMENT  OF  BUILDING  INSPECTION  PERFORMANCE  AUDIT 
Phase  One  Risk  Assessment  Report 


Section  1 - Introduction 

On  April  29,  1999  the  City  & County  of  San  Francisco  (CCSF)  engaged  KPMG  LLP  to  conduct  a 
Performance  Audit  of  the  City  and  County’s  Department  of  Building  Inspection  (DBI).  This 
document  contains  the  results  of  the  initial  phase  of  this  effort  and  is  organized  as  follows: 


Section  2 - General  Approach 

KPMG’s  approach  for  this  project  is  a two  phased  initiative.  The  initial  phase,  a high  level  risk 
assessment  of  the  DBI,  took  place  from  May  14, 1999  until  June  4,  1999.  (The  second  phase,  the 
detailed  execution  of  the  performance  audit  itself,  will  occur  following  acceptance  of  the  Phase 
One  Risk  Assessment  results.)  During  this  initial  phase,  KPMG  sought  to  develop  a broad 
understanding  of  the  practices  currently  employed  by  the  DBI  and  identify  general  areas  of 
higher  risk.  We  used  a twofold  approach  for  this  phase  and  began  by  conducting  a series  of 
focus  interviews  with  a variety  of  Department  personnel.  We  then  carried  out  a high  level 
review  of  some  of  the  Department’s  documented  plans  and  procedures.  Specific  details  of  both 
these  efforts  are  outlined  in  the  sections  below. 


Section  3 - Focus  Interviews 

KPMG  began  the  Phase  One  activities  by  reviewing  the  DBI’s  current  organizational  structure 
and  identifying  those  positions  most  useful  in  helping  us  direct  our  efforts  during  Phase  Two  of 
the  project.  We  devised  a detailed  interview  questionnaire  asking  respondents  to  speculate, 
express  opinion,  make  judgements  and  provide  examples  of  their  answers  rather  than  merely 
providing  yes/no  responses  to  the  standard  set  of  questions.  Our  intent  in  this  exercise  was  to 
encourage  speculation  on  the  part  of  the  interviewee  and  use  their  familiarity  with  the  DBFs 
current  operations  to  help  us  identify  potential  areas  for  improvement.  Table  1 lists  the  DBI 
personnel  interviewed  during  the  conduct  of  Phase  One. 
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Table  1 - Focus  Interview  Listing 


Name 

Position 

Frank  Chiu 

Director 

William  Wong 

Deputy  Director,  Administration 

James  Hutchinsen 

Deputy  Director,  Operations 

Amy  Lee 

Manager,  Administration  & Finance  Division 

Peter  Bums 

Manager,  Code  Enforcement/Disability  Access/Health  & Safety  Division 

Carolyn  Tusch 

Manager,  Central  Permit  Division 

Dennis  King 

Senior  Inspector,  Plumbing  Inspection  Division 

Todd  Huntington 

Manager,  Residential  Plan  Check  Division 

Patty  Perez 

Manager,  Customer  Services  Division 

Steven  Powers 

Inspector,  Electrical  Inspection  Division 

Wing  Lau 

Manager,  Building  Inspection  Division 

Jeffrey  Ma 

Plan  Checker,  Major  Project  Plan  Check  Division 

Sergio  Salvetti 

Inspector,  Housing  Inspection  Division 

Marcus  Armstrong 

Manager,  Management  Information  System  Division 

In  the  limited  time  available,  KPMG  sought  to  interview  not  only  the  senior  leadership  of  the 
department  but  also  middle  level  managers,  first  line  supervisors  and  district  inspectors.  The 
purpose  of  this  was  to  gain  an  appreciation  of  the  overall  strategic  objectives  of  the  DBI  as  well 
as  some  of  the  routine  operational  concerns  affecting  the  Department. 

KPMG  intentionally  concentrated  Phase  One  interviews  in  the  Administrative  Deputate  for  two 
primary  reasons.  The  first  of  these  was  that  this  deputate  has  several  relatively  new  division 
managers.  Secondly,  the  divisions  within  the  Operations  Deputate  are  similar  in  structure  and  in 
purpose.  We  therefore  chose  to  interview  at  least  one  individual  at  each  level  common  to  the 
four  like  divisions.  In  this  manner,  we  were  able  to  ensure  that  we  obtained  a preliminary 
perspective  from  each  of  the  major  functional  divisions  as  well  as  the  point  of  view  of  the 
Department’s  baseline  level  employees.  We  anticipate  the  need  to  conduct  more  focus 
interviews  and/or  seminars  to  support  the  execution  of  Phase  Two,  and  as  such,  will  be  able  to 
solicit  the  opinions  of  other  members  of  the  larger  divisions  within  the  Department. 

KPMG  assembled  the  significant  statistical  data  obtained  during  the  conduct  of  the  focus 
interviews.  This  information  is  located  in  Appendix  A to  this  document. 
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Section  4 - Document  Review 

KPMG’s  Phase  One  efforts  also  included  a cursory  review  of  some  of  the  DBFs  formal 
documentation.  This  review  covered  the  current  Standard  Operating  Procedures  Manuals 
for  the  divisions,  informational  brochures,  quarterly  and  annual  reports,  miscellaneous 
bulletins  and  court  rulings.  Table  2 below  identifies  some  general  observations  and 
specific  associated  examples  made  during  the  conduct  of  this  review. 


Table  2 - Documentation  Review  Observations  1 


Observation 

Example 

Outdated  Information 

Several  documents  still  contain  memoranda  issued  by  the  Department  of  Public 
Works  (DPW)  and  other  information  dated  as  far  back  as  1978.  Some  of  these 
documents  include  the  Operating  Procedures  Manuals  for  Plan  Check  Divisions, 
Special  Projects,  Building  Inspection  Division,  and  Housing  Inspection  Services. 
The  DBI  may  wish  to  conduct  a review  of  these  documents  and  purge  any  obsolete 
information 

Administrative  Policies 

Most  documents  contain  a variety  of  administrative  information  such  as  general  City 
and  Department  Policies,  operational  guidelines  for  the  use  of  radios  and  vehicles, 
employee  handbooks,  and  the  Code  of  Safe  Practices.  The  DBI  might  consider 
consolidating  such  policies  and  procedures  into  a separate  document  common  to  all 
divisions. 

Duplicate  Manuals 

The  Major,  UMB,  Commercial,  and  Residential  Plan  Check  Divisions  all  use  the 
same  Operating  Procedures  Manual.  We  learned  however  during  focus  interviews 
that  procedural  differences  do  exist  between  these  divisions.  Specific  divisional 
annexes  or  addenda  may  be  necessary  for  documenting  these  operational  differences. 

‘A  list  of  the  documents  reviewed  is  located  at  Appendix  B. 


Section  5 - Risk  Assessment  Matrices 

Using  the  information  acquired  via  focus  interviews  and  our  document  review,  KPMG 
developed  two  Risk  Assessment  Matrices  reflected  in  Tables  3 & 4 below.  The  first  matrix 
highlights  the  overall  level  of  risk  in  each  of  the  general  functional  areas  addressed  during  Phase 
One.  Below  Table  3 we  explain  in  more  detail  the  notes  associated  with  the  high  risk  areas 
identified  in  this  first  matrix. 

In  Table  4 we  break  down  the  aggregate  risk  ratings  found  in  Table  3 by  individual  division  of 
the  DBI.  Note  that  some  specific  division  areas  do  not  have  complete  ratings  as  these 
organizational  areas  were  not  addressed  during  the  initial  phase.  However,  some  of  these  non- 
evaluated  divisions  do  reflect  the  DBFs  collective  risk  ratings  where  we  feel  it  is  appropriate. 
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Table  3 - Department  Level  Risk  Assessment  Matrix  by  Functional  Area 


Functional  Area 

Risk  Level 

Example  Areas 

High 

Medium 

Low 

Communication 

X 

• Organization-wide  Communication 

• Meeting  frequency 

Teamwork 

X 

Business  Processes2 

X 

• Performance  Measurement3 

• Plan  Check  Operations4 

• Inspection  Operations4 

• Permit  Issuing  Services3 

Policies  & Procedures2 

X 

• Divisional  Standard  Operating  Procedures6 

• General  Administrative  Policies6 

Reward  & Recognition 

X 

• Employee  recognition  program 

• Suggestion  program 

Information  Systems4 

X 

Roles  & Responsibilities 

X 

Customer  Focus 

X 

Leadership 

X 

Skills  & Training 

X 

• Technical  Sustainment  Training  Program 

Accountability 

X 

• Performance  Appraisal  Program 

• Application  of  management  controls 

^Business  Processes”  and  “Policies  and  Procedures”  Functional  Areas.  Business  Processes  refers  to  the  operational 
functional  processes  in  use  at  the  DBI,  “Policies  and  Procedures”  refers  to  formal  documentation  currently  in  effect  at  the  DBI. 

Performance  Measurement.  The  DBI  diligently  tracks  performance  data  for  several  key  areas  such  as  the  “number  of 
inspections  conducted”  and  “complaint  response  time".  The  DBI,  however,  apparently  does  not  monitor  progress  in  non-core 
functional  areas  such  as  finance  & administration  nor  in  other  core  competencies  reflected  in  divisional  mission  statements.  In 
addition,  the  variety  of  methods  employed  for  monitoring  and  collecting  key  performance  data  indicates  a higher  level  of  risk  in 
this  area. 

“Plan  Check  and  Inspection  Operations.  These  are  two  critical  functions  within  the  DBFs  Operations  Deputate  and  the  results 
of  focus  interviews  indicate  that  these  are  areas  with  significant  potential  for  improvement.  Specific  areas  of  concern  include 
inspection  scheduling  procedures,  plan  check  workflow,  and  complaint  tracking/follow-up. 

sPermit  Issuing  Services.  KPMG  will  examine  this  area  in  conjunction  with  the  review  of  the  DBFs  Permit  Tracking  System 
(PTS).  The  Controller’s  Office  identified  this  as  a primary  focus  area. 

divisional  Standard  Operating  Procedures  and  General  Administrative  Policies.  As  discussed  in  Sections  3 & 4 above,  our 
review  of  departmental  policies  and  procedures  identified  numerous  shortcomings  in  this  area.  Although  significant  opportunity 
for  improvement  exists  throughout  the  DBI,  KPMG  contends  that  this  weakness  does  not  substantially  impact  departmental 
operations. 
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Teamwork 
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J 
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Communication 
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£ 
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ADMINISTRATION 

• Administration  & 
Finance  Division 

• Code  Enforcement 
Division 

• Central  Permits 
Division 

• Records 
Management 
Division 

I • Personnel  Division 

I • Technical  Services 

• Management 
Information  Division 

OTHER 

j Customer  Services 

H - High  Risk  Potential 

VI  - Medium  Risk  Potential 

L - Low  Risk  Potential 

JBlank  areas  not  evaluated  during  Phase  One. 
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Section  6 - Conclusion 

Despite  the  cursory  level  of  our  review  during  the  first  phase  of  this  performance  audit,  we 
believe  that  the  areas  identified  during  this  risk  assessment  warrant  closer  examination.  Since  the 
high  risk  areas  and  even  the  example  functions  within  these  areas  are  broad  and  require  further 
definition,  KPMG  recommends  awaiting  the  Controller’s  Office  acceptance  of  this  assessment 
before  proceeding  into  Phase  Two. 

Although  KPMG  rated  the  “Management  Information  Systems”  functional  area  as  high  risk,  we 
recommend  not  emphasizing  this  area  during  the  second  phase.  We  contend  that  the  Oracle 
system  implementation  now  underway  creates  too  dynamic  a working  environment  to  effectively 
evaluate  this  area.  We  will  however  evaluate,  as  originally  requested,  the  effectiveness  of  the 
existing  Permit  Tracking  System  (PTS). 

Together  with  the  CCSF  Controller’s  Office  staff  we  recommend  joint  discussion  on  the  possible 
approaches  for  Phase  Two  activities  so  as  to  arrive  at  a common  understanding  of  the  methods 
and  approaches  to  be  used. 
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Appendix  A - Statistical  Data 

In  order  to  help  identify  potential  areas  of  higher  risk  existing  within  the  DBI,  our  Phase  One 
focus  interview  questionnaire  included  a number  of  questions  requiring  rank  order  responses 
from  each  interviewee.  From  a set  of  twelve  functional  areas,  respondents  were  asked  to  idendfy 
those  areas  where  a significant  opportunity  for  improvement  exists  within  the  organization.  We 
then  asked  them  to  rank  order  these  areas,  and  estimate  both  the  current  level  of  effectiveness  and 
the  opportunity  for  improvement.  The  data  displayed  in  Figures  1 - 4 of  this  section  reflects  the 
responses  received  during  this  effort. 

The  data  in  the  following  graphs  should  not  be  confused  with  the  ratings  found  in  the  risk 
assessment  matrices  found  in  Section  5.  This  data  is  provided  only  to  help  clarify  the  nature  of 
the  responses  and  lend  general  support  to  the  ratings  found  in  Tables  3 & 4.  Although  they  do 
not  uniformly  concur  with  KPMG’s  ratings,  they  are  in  most  cases,  complementary. 
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Figure  1 - Significant  Areas  for  Potential  Improvement 
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Figure  2 - Rank  Order  of  Areas  for  Potential  Improvement 
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Figure  3 Current  Department  Effectiveness 
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Figure  4 - Potential  Improvement  Assessment 
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Appendix  A - Document  Listing 


The  Department  of  Building  Inspection  provided  the  following  documents  for  our  review  during 
the  conduct  of  Phase  One: 


1.  Issued  Disabled  Access  Bulletins  As  of  March  1999 

2.  DBI  Office  Policy  and  Procedures  for  Field  Inspection  Consistency  #OP-0 13.98,  February  12, 
1998 

3.  Quality  Control  Activity  Report,  February  17  - April  12,  1999 

4.  Inventory  and  Audit  of  the  DBI  Network  prepared  by  Computown,  December  12,  1999 

5.  Memo  on  Dismissal  of  Lawsuit  on  Disability  Access  Enforcement,  August  31,  1998 

6.  Draft  Focus  Group  Meetings  Summary  Report,  California  Board  of  Architectural  Examiners 
prepared  by  Moore,  Iacofano,  Goltsman,  Inc.,  November  1998 

7.  Civil  Grand  Jury  Reports,  City  & County  of  San  Francisco,  1996  - 1997 

8.  Compilation  of  DBI  Brochures 

9.  Standard  Operating  Procedures  Manual 

> Customer  Services 

> Operations  Program 

- Building  Inspection 

- Electrical  Inspection 

- Housing  Inspection  Services 

- Major  & UMB  Plan  Check 

- Mechanical  Plan  Check 

- Plan  Check  Services 

■ Commercial  Plan  Check 

■ Major  & UMB  Plan  Check 

■ Residential  Plan  Check 

- Plumbing  Inspection 

- Special  Projects 

- UMB /Parapet  Programs 
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> Administration  Program 

- Administrative  & Finance 

■ APDICS 

■ Controller’s  & Citywide  Policies,  Memos  & Guidelines 

■ FAMIS 

- Central  Permit  Bureau 

- Code  Enforcement/Disabled  Access/Health  & Safety 

■ Code  Enforcement  Division 

■ Disabled  Access 

■ Lead  Hazard  Reduction  Program 

- Management  Information  Services 

- Personnel  & Payroll 

- Records  Management 

- Technical  Services 

10.  One-Stop  Permit  Coordinating  Program,  Standard  Operating  Procedures  Manual 

11.  Management  Information  Services,  Standard  Operating  Procedures  Manual 

12.  DBFs  Purpose,  Mission,  Highlights  for  1995,  1996 

13.  Director’s  Christmas  Message  to  DBI  Staff  and  Friends,  1997  & 1998 

14.  Director’s  Memo  to  Controller’s  Office  and  Mayor’s  Office  on  Budget  Performance 
Measures,  FY  1999-2000 

15.  Organizational  Chart 

> DPW,  Bureau  of  Building  Inspection,  November  1994 

> DBI,  Proposed  FY  95-96  Organizational  Chart,  January  1995  (draft) 

> DBI,  Organization  Chart  FY  94-95,  May  1995  (draft) 

> DBI,  Organization  Chart  FY  95-96,  February  28,  1996 

> DBI,  Organization  Chart  FY  96-97,  December  1996 

> DBI,  Organization  Chart  FY  1998-1999,  April  1999 

16.  Director’s  Memo  on  Reorganization  of  the  Department  of  Building  Inspection,  January  25, 
1999 

17.  Proposition  G,  Creating  Department  of  Building  Inspection 

18.  Quarterly  Reports  1996-97, 4th  Quarter  Report 
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Activity  Matrices 


Inspection  Divisions 

Division:  Housing  Inspection  Services  Division 

Name:  Paul  Lansdorf 

Position:  Housing  Inspector 

Tenure:  14  years 


C 


Daily 

Hours 

- 

SO 

<N 

00 

.09 

.07 

o 

8.23 

Monthly 

Hours 

21.76 

130.56 

5.44 

17.41 

(N 

*r> 

179.17 

Output  or  Disposition 

Inspection  scheduled 

Approve  permits  / reinspections  / 
issue  correction  notices 

Customer  service 

Customer  service 

Keep  up  with  industry  changes 

Condo  conversions 

Various 

Total 

Input  or  Source 

Phone  calls  from  customers 

Electrical  permits  / 
inspector’s  job  cards 

Customer  inquiries 

Answer  customer  inquiries 
and  assist  in  permit 
processing 

From  Chief  Inspector 

Customer 

Customer 

Typical 
Workload/ 
# of  Items 

8 to  20 

o 

o 

00 

- 

! 

- 

- 

- 

Time 

Required 

(Hrs) 

- 

so 

<N 

oo 

- 

1 to  2 

■n 

Frequency 

(D,W,M,Q, 

Y) 

a 

o 

Q 

Bi-weekly 

2 

2 

2 

Task/Activity 

Schedule  electrical 
inspections 

Conduct  electrical 
inspections 

Answer  code 
questions 

Staffing  office 

Attend  technical 
training 

3-R  inspections  and 
report 

Special  inspections 

-1 
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Daily 

Hours 

lO 

.05 

CN 

.09 

in 

IT) 

9.24 

Monthly 

Hours 

21.76 

65.28 

32.64 

- 

43.52 

4.35 

- 

00 

00 

OO 

© 

OO 

OO 

© 

© 

© 

Output  or  Disposition 

Inspection  scheduled 

Approve  permits,  reinspections, 
issue  Correction  Notices 

Customer  service 

Satisfy  state  safety  training 
requirements,  communication 
within  the  Division 

Monitor  staff  performance,  resolve 
any  staffing  issues 

Abatement,  issue  Correction 
Notice,  issue  Notice  of  Violation 

Abatement,  issue  Notice  of 
Violation 

Answer  inquiries  from  the  public 

Answer  code  questions 

Customer  service 

Total 

Input  or  Source 

Phone  calls  from  customers 

Electrical  permits  / 
inspector’s  job  cards 

Customer  inquiries  - walk- 
ins,  phone  calls 

Mandatory  state  safety 
training,  Division  issues 

Daily  activities  reports 
submitted  by  District 
Inspectors 

Calls  and  letters  from  the 
public,  referrals  from  other 
Divisions,  departments. 
Mayor’s  office,  Board  of 
Supervisors,  and  etc. 

Calls  from  neighbors 

Letters  from  the  public 

Inquiries  regarding  code 
from  the  contractors, 
property  owners 

Call  customers  back  to 
schedule  appointments 

Typical 
Workload/ 
It  of  Items 

© 

SO 

OO 

- 

OO 

- 

ts 

<N 

© 

Time 

Required 

(Hrs) 

- 

en 

*n 

- 

CN 

- 

- 

- 

■n 

«n 

Frequency 

(D,W,M,Q, 

Y) 

Q 

Q 

Q 

2 

Q 

£ 

2 

£ 

Q 

Q 

Task/Activity 

Schedule  electrical 
inspections 

Conduct  electrical 
inspections 

Answer  customer 
inquiries 

Safety  training/ 
Staff  meetings 

Supervise  electrical 

inspectors’ 

activities 

Investigate 

complaints 

Investigate  work 
without  permits 

Written 

correspondence 

Code  research 

Phone  messages 
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'© 

2.18 

8801 

4.35 

198.02 

Output  or  Disposition 

Inspection  scheduled 

Record  keeping 

Approve  permits,  reinspections, 
issue  Correction  Notices 

Condo  conversions 

Abatement,  issue  Correction 
Notice,  issue  Notice  of  Violation 

Satisfy  safety  training 
requirements,  Divisional 
communication 

Customer  service 

Car  maintenance 

Total 

Input  or  Source 

Phone  calls  from  customers 

Copies  of 

Applications/Permits 

Plumbing  permits  / 
inspector’s  job  cards 

Customer 

Calls  and  letters  from  the 
public,  referrals  from  other 
Divisions,  departments, 
Mayor’s  office,  Board  of 
Supervisors,  and  etc. 

Mandatory  state  safety 
training,  Division  issues 

Customer  inquiries  - walk- 
ins,  phone  calls 

Car  maintenance 

Typical 
Workload/ 
it  of  Items 

10  to  15 

10  to  20  filed 

10  to  15 
inspections 

2 to  3 

- 

- 

2 to  4 
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If  1 :S  I 

= 5 z S,  h 


Daily 

Hours 

5.5 

2 

(N 

- 

• ■> 

.03 

r- 

°o 

00 

Monthly 

Hours 

32.64 

10.88 

1 19.68 

4.35 

2.18 

8.70 

8801 

192.98 

Output  or  Disposition 

Inspection  scheduled 

Record  keeping 

Approve  permits,  reinspections, 
issue  Correction  Notices 

Condo  conversions 

Satisfy  safety  training 
requirements.  Divisional 
communication 

Car  maintenance 

Customer  service 

Customer  service 

Keep  up  with  industry  changes 

Total 

Input  or  Source 

Phone  calls  from  customers 

Copies  of 

Applications/Permits 

Plumbing  permits  / 
inspector’s  job  cards 

Customer 

Mandatory  state  safety 
training,  Division  issues 

Car  maintenance 

Public 

Customer  inquiries  - walk- 
ins,  phone  calls 

From  Chief  Inspector 

Typical 
Workload/ 
it  of  Items 

- 

12  to  20 

10  to  12 

- 

I - staff 
1 - safety 

- 

3 to  4 
complaints 

3 to  4 

- 

Time 

Required 

(Hrs) 

»n 

in 

5 to  6 hours 

(N 

- 

- 

«n 

00 

Frequency 

(D,W,M,Q, 

Y) 

Q 

O 

Q 

2 

Bi-weekly 

Bi-weekly 

£ 

Q 

> 

Task/Activity 

Schedule  plumbing 
inspections 

Daily  filing 

Conduct  plumbing 
inspections 

Conduct  3-R 
inspections  and 
report  write-ups 

Participate  in 

staff/safety 

meetings 

Gas  up  car  and  car 
wash 

Complaint  letter 
writing 

Answer  customer 
inquiries 

Attend  technical 
training 
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Daily 

Hours 

in 

<n 

- 

- 

.07 

8.57 

Monthly 

Hours 

00 

00 

© 

oo 

oo 

O 

21.76 

43.52 

in 

186.46 

Output  or  Disposition 

Inspection  schedule 

Abatement,  apartment/hotel 
ratings,  issue  Notice  of  Violation 

Customer  service 

Daily  activities  report  recorded  in 
Oracle  System,  letters  written  to 
property  owners,  build  up  database 
for  routine  inspections 

Satisfy  safety  training 
requirements,  Divisional 
communication 

Total 

Input  or  Source 

Calls,  letters  from  the 
public,  referrals  from  other 
Divisions,  departments. 
Mayor’s  office,  list  of 
apartments  and  hotels  in  the 
district 

Complaints,  routine 
inspections 

Customer  inquiries  - walk- 
ins,  phone  calls 

Paperwork  collected  from 
inspections  conducted 
during  the  day 

Mandatory  state  safety 
training,  Division  issues 

Typical 
Workload/ 
# of  Items 

1 to  3 

6 to7 

20  calls 

Various 

- 

Time 

Required 

(Hrs) 

- 

- 

C'l 

1 to  2 

Frequency 

(D,W,M,Q, 

Y) 

Q 

O 

Q 

Q 

Task/Activity 

Schedule 
complaints  and 
routine  inspections 

Conduct 

inspections 

Answer  customer 
inquiries 

Office  work  (input 
paperwork) 

Staff/safety 

meetings 
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19.58 

.45 
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.67 

87.04 

174.17 

Output  or  Disposition 

Property  rated,  access  into  the 
building  denied,  write  letter  to 
property  owner  requesting  access, 
inspection  of  building  exterior, 
issue  Notice  of  Violation 

Abatement,  issue  Notice  of 
Violation 

Write-up  inspection 

Customer  service 

Satisfy  safety  training 
requirements,  Divisional 
communication 

Keep  up  with  code  changes 

Daily  activities  report  recorded  in 
Oracle  System,  letters  written  to 
property  owners,  build  up  database 
for  routine  inspections 

Total 

Input  or  Source 

List  of  apartments/hotels  in 
the  district 

Public,  referrals  from  other 
Divisions,  departments,  and 
Mayor’s  office 

Request  from  the  public 

Public 

Mandatory  state  safety 
training,  Division  issues 

From  Chief  Inspector 

Paperwork  collected  from 
inspections  conducted 
during  the  day 

Typical 
Workload/ 
# of  Items 

- 

20 

o 

- 

Various 

Time 

Required 

(Hrs) 

oo 

OS 

.45 

30 

- 

00 

■Ct 

Frequency 

(D,W,M,Q, 

Y) 

o 

Q 

2 

>* 

Q 

2 

Sm 

Q 

Task/Activity 

Conduct  routine 
inspections 

Conduct  complaint 
inspections 

Conduct  energy 
inspections 

Residential  hotel 
annual  inspections 

Public  phone 
inquiries 

Staff/safety 

meetings 

Technical  training 

Office  work  (input 
paperwork) 

'O 


Appendix  B - Activity  Matrices 


City  and  County  of  San  Francisco  Department  of  Building  Inspection 
Performance  Audit 


g 

o •-  O O 
,«2  3 '£  c 
^ o « flj 
.2  K Cl  00 

Q 


» § s 

JEQZix 


Daily 
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Monthly 
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10.88 

43.52 

00 

2.17 

r- 

00 

4.35 

4.35 

3.26 

4.35 

- 

- 

j 

C 

i 

i 

d 

! 

L 

3. 

Customer  service 

Customer  service 

Monitor  performance  of  the  district 
inspectors 

Resolution  on  outstanding  cases 

Abatement,  apartment/hotel 
ratings,  issue  Notice  of  Violation 

Satisfy  safety  training 
requirements,  Divisional 
communication 

Report  to  Chief  Inspector 

Answer  inquiries,  customer 
serviced 

Scheduling/staffing 

Input  or  Source 

Available  to  answer 
customer  inquiries  at  the 
counter 

Customer  inquiries  - 
phone  calls 

Daily  activities  of  district 
inspectors 

Cases  managed  by  district 
inspectors 

Complaints,  routine 
inspections 

Mandatory  state  safety 
training.  Division  issues 

Input  from  district 
inspectors 

Letters  from  the  public 

Staff  schedules 

Typical 
Workload/ 
it  of  Items 

! 

4 calls 

6 - daily 

v© 

Varies 

1 0 to  15  cases 

- 

- 

- 

- 

2 letters 

- 

Time 

Required 

(Hrs) 

in 

in 

*1 
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- 

- 

(N 

«n 

- 

- 

- 

1? 
CP  « 
£ : 
Eb  $ 

> 

£ 

$ 

Q 

a 

Q 

£ 

£ 

£ 

£ 

Bi-weekly 

Bi-weekly 

£ 

2 

2 

Task/Activity 

Senior  office  duty 

Answer  customer 
inquiries 

Review  dailies/ 
consult  w/  inspectors 

Review  Director’s 
Hearing  referrals 
and  billings 

Residential  hotel 
audit 

Director’s  Hearing 
representative 

Field  inspections 

Staff 

meetings/safety 

training 

Senior  staff 
meetings 

Weekly  reports 

Respond  to 
Director’s  letters 

Office  duty 
scheduling 
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Inspection  Divisions 

Division:  Housing  Inspection  Services  Division 

Name:  Patrick  McKenzie 

Position:  Senior  Housing  Inspector 

Tenure:  6 years 


>5  § 
1 1 
*■ 
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Daily 

Hours 

.02 
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.07 
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.004 

.004 

p 
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.03 

oo 

vn 

t"; 

oo 

Monthly 

Hours 

■'d- 

r-; 

1.66 

r- 

oo 

o 

p 

$ 

89061 

Output  or  Disposition 

Referred  to  city  attorney 

Output  - to  Chief  for  review 

Keep  up  with  code  changes 

Total 

Input  or  Source 

Cases  managed  by  district 
inspectors 

Input  - from  weekly  and 
monthly  reports 

From  Chief  Inspector 

Typical 
Workload/ 
# of  Items 

400 

assessments 

vO 

- 

VO 

- 

- 

- 

- 

Time 
Required 
(Hrs)  • 

*n 

- 

>o 

- 

- 

VO 

OO 

Frequency 

(D,W,M,Q, 

Y) 

2 

O' 

a 

a 

a 

>* 

>- 

>H 

>- 

>- 

Task/Activity 

City  attorney  referral 
update 

Residential  hotel 
assessments 

Abatement  billing 
audit 

HIS  quarterly  report 

Standard  report 

Staff  meeting 
scheduling 

Director’s  Hearing 
scheduling 

Training  coordinator 

Conduct  training 

Attend  technical 
training 
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Inspection  Divisions 

Division:  Building  Inspection  Division 

Name:  Andrew  Greene 

Position:  Senior  Building  Inspector 

Tenure:  16  years 
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Output  or  Disposition 

Referred  to  city  attorney 

Output  - to  Chief  for  review 

Keep  up  with  code  changes 

Total 

Input  or  Source 

Cases  managed  by  district 
inspectors 

Input  - from  weekly  and 
monthly  reports 

From  Chief  Inspector 

Typical 
Workload/ 
it  of  Items 
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Time 
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(Hrs) 

in 
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00 

Frequency 
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Y) 

2 

a 

a 

O' 
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Task/Activity 

City  attorney  referral 
update 

Residential  hotel 
assessments 

Abatement  billing 
audit 

HIS  quarterly  report 

0 

o. 

u 

-o 

-b 

c 

w 

Staff  meeting 
scheduling 

Director’s  Hearing 
scheduling 

Training  coordinator 

Conduct  training 

Attend  technical 
training 
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Inspection  Divisions 

Division:  Building  Inspection  Division 

Name:  Andrew  Greene 

Position:  Senior  Building  Inspector 

Tenure:  16  years 
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Plan  Check 

Division:  Major  Projects  Plan  Check 
Name:  Kung-Kay  Chiu 

Position:  Major  Projects  Plan  Checker  (Engineer) 
Tenure:  9 Years 
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Task/Activity 
Meetings  / 

Administration 

Arrange 

instructional 

seminars 

Coordinate 
approval  process  of 
new  methods 

Assist  other 
departments 

umer 

Emergency  field 
response 

| TOTAL  | 
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Central  Permit  Bureau 

Division:  Central  Permit  Bureau 

Name:  Carolynn  Tusch 

Position:  Manager 

Tenure:  28  years 
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Monthly 
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Output  or  Disposition 

Sent  out  certificate  to 
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Central  Permit  Bureau 

Division:  Central  Permit  Bureau 

Name:  Fidel  Del  Rosario 

Position:  Senior  Clerk,  Typist 
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Daily 
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- 

- 

CN 

C^. 
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00 

Monthly 

Hours 

21.76 

21.76 

43.52 

65.28 

21.76 

174.08 

Output  or  Disposition 

Applications  routed  to  specific 
stations  for  review 

Building  permit  paid  and  issued 

Eleclrical/plumbing  permits  issued 

Notifications  are  sent  - application 
plans  are  placed  on  a 15  day  hold, 
Answer  customer  inquiries 

Answer  customer  inquiries 

Total 

Input  or  Source 

Plan  check  review 

All  stations  signed  off 

Applications  filed  by 
contractors 

Issuance  of  building  permit. 
Calls  from  the  public  or 
customers 

Calls  from  the  public  or 
customers 

Typical 
Workload/ 
if  of  Items 
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00 

\o 
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Time 
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(Hrs) 

- 

- 

- 

- 

Frequency 

(D,W,M,Q, 

Y) 

Q 

O 

Q 

Q 

Q 

Task/Activity 

Accept  filing 
applications 

Issue  building 
permits 

Issue  plumbing  and 
electrical  permits 

Notification  of 
structure  additions 

Phone  duty 

Appendix  B - Activity  Matrices  - B - 22 


City  and  County  of  San  Francisco  Department  of  Building  Inspection 
Performance  Audit 


- oo 


S .5  « 2 
- C 5 'EL  ® 

2 * ««- 
SP* 


CD 

^ 0)  C 

lu  = 

u. 

O 

a. 


D 


<D 


U CM 


>»  2 

1 § 
Q k 


Z £ 


_ ^ g 

«si 


1 1- 

cr^ 


| 

o .S 


ill. 


D 5 
s e 
= < 
2 Q. 


.J»  = 

- S 5 

c w — 
D «J 


«M  2 

= o . 
i Z 3 fc  t 


ti 


Appendix  B - Activity  Matrices  - B • 23 


City  and  County  of  San  Francisco  Department  of  Building  Inspection 
Performance  Audit 


Appendix  B — Activity  Matrices  - B - 24 


One  Stop  Permits 

Division:  One-Stop  Permits 
Name:  Max  Putra 
Position:  Permit  Coordinator 
Tenure:  1 year  (current  position) 
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Daily 
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1 two  1 
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0.075 
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Monthly 
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1 900 
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Output  or  Disposition 

Application  accepted  or  returned 
with  request  for  additional 
documentation,  copies 

Application  ready  for  screening 
appointment??? 

Single  original  set  of  plans  with 
comments  from  all  departments 

Referrals  or  resolution  of  customer 
concern 

Approved  plans  with  necessary 
signatures,  stamps  and  other  errors 
corrected 

Revised  plans  ready  for  review  by 
plan  checker 

< 

Z 

NA 

NA 

[NA 

Input  or  Source 

Permit  application 
submitted  by  customer 

Permit  application 
submitted  by  customer??? 

Multiple  plan  copies  with 
written  comments  by  plan 
reviewers  in  different  city 
departments 

Customer  calls 

Approved  plans,  including 
some  with  errors  (from 
regular,  sequential  plan 
check  process) 

Applicant  revisions  to  plans 
in  response  to  plan  checker 
comments 

< 

z 

NA 

NA 

NA 

Typical 
Workload/ 
# of  Items 
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00 
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2 

Task/Activity 

Screen 

applications 

Accept  permit 
applications  for 
screening 

Transfer 
comments  from 
copies  to  original 
permit  plans 

Answer  customer 
inquiries 

Perform  quality 
control  checks  of 
approved 
applications 

Take  in  applicant 
revisions  to  plans 

C 

'E 

CL 

Participate  in 
training 

Attend  staff 
meetings 

Research 
applications  per 
DBI  staff 
requests 

< 

c_ 
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Output  or  Disposition 
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Input  or  Source 

NA 
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Workload/ 
# of  Items 

- 

Time 
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rr 
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Task/Activity 

Attend  technical 
training 

Attend  staff 
meetings 

| TOTAL  i 
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Benchmarking  Profiles 


Explanation  of  the  Appendix 

Appendix  C of  this  report  contains  profiles  of  those  jurisdictions  surveyed  in  the  course 
of  the  benchmarking  analysis.  Each  of  these  profiles  contains  the  following  information: 


Table  C -1  - Elements  of  Benchmarking  Profiles 


Profile  Element 

Comment 

Population 

Population  in  the  jurisdiction  served 

Department 

Title  of  the  department  and  division  where  plan 
check  and  inspection  functions  are  performed 

Building  Inspection  Annual  Volumes 

Most  recently  available  annual  activity  volumes  (or 
estimates)  for  major  building  inspection  activities 

Summary  of  Performance  Measurement  and 
Business  Practices 

Information  on  the  following  for  inspections  and 
plan  review  functions: 

■ Performance  Targets 

■ Performance  Target  Development 

■ Management  Utilization 

KPAm 
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Profiles  of  Performance  Measurement  in  Selected  Jurisdictions 
- California 


County  of  Santa  Clara,  CA 

Population: 

1,641,215 

Department: 

Department  of  Building  Inspection  Land  Development  and  Surveying  Office 

Building  Inspection  Annual  Volumes: 

28,567  permits  issued 

13,037  plans  reviewed 
18,209  inspections  performed 

Summary  of  Performance  Measurement  and  Business  Practices: 

Inspections: 

All  inspectors  have  multiple  certifications  and  perform  combination  inspections. 
Combination  inspection  is  considered  the  most  efficient  method  of  minimizing  the  long 
distances  and  times  necessary  to  travel  between  inspection  sites  in  unincorporated  areas. 
Inspectors  commonly  drive  in  excess  of  120  miles  per  day. 

Management  utilizes  only  one  performance  measure  for  the  inspectors. 


Performance  Measure 

Performance  Target 

Percentage  Inspection  Responses 
within  24  Hours* 

90% 

99%  level  achieved 

*For  those  requests  made  by  3:00  PM  of  the  previous  day 


Performance  Target  Development 

Performance  target  levels  are  based  on  historic  department  experience  and  are 
regularly  exceeded. 


OTP 
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Management  Utilization 

Management  does  not  rely  on  the  24-hour  response  time  performance  indicator. 
Due  to  the  small  staff  size,  management  views  senior  inspector  oversight  as  adequate  in 
identifying  inefficiencies  and  monitoring  employee  performance.  Complaints  are  used  as 
an  additional,  informal  indicator  of  quality. 

Plan  Review 

The  County  employs  five  plan  checkers  for  reviews.  Of  the  five,  two  hold 
combination  certifications  while  the  remaining  are  craft  specific. 


Performance  Targets  by  Plan  Review  Type 

Performance  Measure 

Residential 

Non-Residential** 

OTC 

Plan  Review  Turn  Around  Time 

30  Calendar  Days 
Target  90% 

45  Calendar  Days 
Target  90% 

Percentage  of  OTC  Customers 
Wait  Times  under  20  Minutes 

Target  90% 

**Very  few  commercial  plans  are  reviewed. 


Performance  Target  Development 

Performance  target  levels  were  established  by  department  management  based  on 
historic  data  and  surveys  of  performance  measurement  in  neighboring  jurisdictions 

Management  Utilization 

Directors  and  management  meet  on  a monthly  basis  to  review  performance 
measurement  and  achievement  of  goals.  Based  on  the  information  obtained,  management 
also  determines  whether  the  measurements  require  adjustments  or  modifications. 


KPM& 
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Profiles  of  Performance  Measurement  in  Selected  Jurisdictions 
- California 


County  of  San  Diego,  CA 

Population: 

2,780,592 

Department: 

Department  of  Planning  and  Land  Use  Building  Permits 

Building  Inspection  Annual  Volumes: 

10,000  permits  issued 

1783  plans  reviewed 
35,014  inspections  performed 

Summary  of  Performance  Measurement  and  Business  Practices: 

Inspections: 

All  inspectors  have  multiple  certifications  and  perform  combination  inspections 
on  either  residential  or  commercial  projects.  Combination  inspection  is  considered  the 
most  efficient  method  of  minimizing  long  distances  that  often  total  in  excess  of  200  miles 
per  day. 


Performance  Targets  by  Inspection  Type 

Performance  Measure 

Residential 

Commercial 

Inspections  per  Inspector 

8.4* 

8.4* 

per  Day 

Actual  20-25/day 

Actual  12-15/day 

Percentage  Inspection 

100% 

100% 

Responses  within  24 
Hours* 

Target  achieved 

Target  achieved 

^Includes  responses  to  inspections  in  the  rural  county  areas  exceeding  24  hours  but  meeting  scheduled  time 
frames. 


Performance  Target  Development 

Performance  measures  for  inspections  were  developed  approximately  15  years 
ago  and  have  not  been  updated. 

Management  Utilization 

Current  performance  targets  are  regularly  exceeded  and  are  seldom  used  by 
management.  A review  of  current  measures  and  targets  is  currently  in  place. 
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Plan  Review 

The  County  employs  five  certified  engineers  of  whom  only  one  performs 
electrical,  mechanical  and  plumbing  reviews.  All  other  engineers  review  plans  for 
compliance  with  life,  structural  and  safety  codes.  Approximately  85%  of  the  plans 
reviewed  and  inspections  performed  are  for  residential  properties. 


Performance  Targets  by  Plan  Review  Type 

Performance  Measure 

Residential 

Commercial 

Plan  Review  Turnaround 
Time 

10  day 

Target  80-85%* 

15  day 

Target  80-85%* 

*The  County  is  currently  unable  to  meet  80-85%  target  level  as  a result  of  code  changes  effective  7/1/99. 


Performance  Target  Development 

Performance  measures  for  inspections  were  developed  approximately  15  years 
ago  and  have  not  been  updated. 

Management  Utilization 

A review  of  current  measures  and  targets  is  currently  in  place  along  with  the 
implementation  of  a new  permit  tracking  system.  Current  plan  review  turnaround  times 
are  monitored  monthly  and  contract  services  are  employed  when  times  fall  substantially 
below  targets.  This  can  occur  during  periods  of  high  construction  activity. 


Management  Initiatives: 

Audits  of  Inspection  Quality 

To  ensure  inspections  are  conducted  in  a time  efficient  and  thorough  manner,  the 
Department  has  established  a program  of  complete  and  spot  audits. 

Complete  Audits 

■ On  a given  day  without  notice  a Senior  Inspector  re-performs  all  inspections  and 
retraces  the  prior  day’s  route  of  a selected  inspector. 

■ Both  the  quality  of  the  inspection  and  the  thoroughness  and  accuracy  of  the 
recorded  data  including  driving  times  and  miles  claimed  are  reviewed. 

■ All  inspectors  undergo  a complete  audit  once  annually. 

Spot  Audits 

■ A Senior  Inspector  selects  5 approved  permits  (completed  final  inspections)  at 
random  on  a monthly  basis,  reviewing  paperwork  and  re-performing  the 
inspection  to  assess  the  quality  of  the  work. 

Following  the  complete  or  spot  audits,  the  auditees  meet  with  the  Director  and  review 
their  performance.  Audit  are  used  for  reward  or  training  purposes.  Management 
considers  omissions  by  audited  inspectors  as  strong  indications  of  those  areas  in  which  all 
inspectors  require  additional  training. 
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Profiles  of  Performance  Measurement  in  Selected  Jurisdictions 
- California 


City  of  San  Diego,  California 

Population: 

1.254.000 

Department: 

Planning  and  Development  Review  Department 

Building  Inspection  Annual  Volumes: 

30.000  permits  issued 

3740  plans  checked 
162,327  inspections  performed 

Summary  of  Performance  Measurement  and  Business  Practices: 

Inspections 

San  Diego  employs  both  combination  and  specialty  inspectors.  Combination 
inspectors  focus  their  efforts  on  one  to  two  family  residential  sites,  while  specialty 
structural,  electrical  and  mechanical  inspectors  handle  multi-family  residential  and  all 
commercial  structures.  Only  inspection  response  times  are  tracked. 


Performance  Measure 

Target  Performance  Level 

Percentage  Inspection  Responses  within  24  Hours 

95%* 

^Target  performance  level  met  after  recent  staff  increases.  Prior  to  this,  performance  levels  averaged  90%. 

In  addition  to  measuring  response  times,  San  Diego  utilizes  two  additional 
performance  indicators  for  inspection  related  activities. 


Additional  Inspection-Related  Measures 


Performance  Measure 

Target  Performance  Level 

Percentage  Of  Technical  Support  Provided  To  Inspection  Staff 

99% 

Within  2 Working  Days 

Target  met. 

Percentage  Of  Inspection  Requests  Scheduled  within  a 

100% 

Telephone  Wait  Time  of  2 Minutes 

97%  average  of  target  met. 
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Target  Development 

The  Department  chose  to  rely  on  a single  performance  measure  for  inspection 
services  as  a result  of  a recent,  comprehensive  review  process  to  produce  more  customer- 
focused  measures  of  performance. 

Management  Utilization 

If  performance  falls  below  the  95%  target  level  for  a prolonged  period  of  time, 
staff  increases  are  considered.  (Due  to  budget  constraints  throughout  much  of  the  1990s, 
staff  was  not  increased  despite  consistent  performance  at  the  90%  level.) 

Supervisors  monitor  individual  workloads  and  adjust  workloads  on  a daily  basis. 
An  automated  system  assigns  voice  mail  requests  for  inspections  to  the  appropriate 
geographic  districts.  Inspectors  are  responsible  for  inspections  in  their  assigned  districts. 
Supervisors  review  computer-assigned  workloads  per  inspector  at  the  start  of  the  business 
day,  redistributing  inspection  workload  as  necessary.  Geographic  district  boundaries  and 
inspector  assignments  are  readjusted  periodically  for  fast  growth,  new  development  areas. 

Plan  Review 

No  specific  individual  performance  measures  or  targets  are  maintained  for  plan 
review  personnel.  Plan  review  personnel  are  divided  into  three  groups  that  assess 
compliance  with  different  codes  - structural,  electrical  and  plumbing/mechanical. 

Total  actual  times  for  plan  approval  (inclusive  of  all  city  departments  for  which 
approval  is  required)  are  outlined  below  by  plan  type.  Separate  plan  review  times  for  the 
construction  code  plan  checkers  are  not  tracked. 


Plan  Check  Group 

Target  Review  Times  by  Plan  Type* 

Commercial 

Multi-Family 

Residential 
(1-2  Families) 

Structural 

30  days 

30  days 

8 days 

Electrical 

6 days 

6 days 

NA 

Plumbing/Mechanical 

1 1 days 

1 1 days 

8 days 

Satisfactory  performance  level  is  90%  of  target. 

*Review  times  do  not  include  customer  time  taken  to  revise  plans  after  initial  plan  review. 


Of  the  30,000  plans  approved  annually,  some  25,000  are  performed  over-the- 
counter  (OTC),  or  approximately  83%. 

In  addition  to  measuring  plan  review  times,  San  Diego  utilizes  two  additional 
performance  indicators  for  plan  review  related  activities.  Both  focus  on  importance  of 
providing  rapid  information  on  code  interpretation  issues  to  customer  groups. 
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Additional  Plan  Review-Related  Measures 


Performance  Measure 

Target  Performance  Level 

Percentage  Of  Technical  Inquiry  Questions  Answered  within 
the  Same  Day 

90% 

Target  met. 

Percentage  of  Technical  Interpretations  Published  within  60 
Days  of  a Policy  Issue  Referral 

80% 

Target  met. 

Target  Development 

The  Department  developed  target  performance  levels  for  plan  review  in 
consultation  with  customer  groups  and  construction  industry  organizations. 

Management  Utilization 

Management  reviews  performance  levels  on  a quarterly  basis.  If  performance 
falls  below  the  90%  target  level  in  a code  group/plan  type  category  for  a 3 -month  period, 
management  takes  corrective  steps  including  increases  to  allowed  overtime,  reviews  of 
individual  staff  performance  and  assessment  of  total  staff  levels.  Performance  of 
individual  plan  checkers  is  monitored  at  the  supervisory  level. 

Management  Initiatives: 

Development  Plan  Managers 

San  Diego  utilizes  Development  Plan  Managers  as  a single  point  of  contact  for 
customers  with  plans  requiring  public  hearings  or  plan  reviews  by  multiple  city 
departments.  Staff  employed  in  these  roles  come  from  varied  backgrounds  - permit 
clerical  staff  to  ex-plan  reviewers  - and  handle  applications  of  differing  complexity.  In 
consultation  with  the  customer,  the  Plan  Manager  assesses  the  completeness  of  the 
application,  indicates  additional  documentation  necessary  for  submission,  and  provides 
the  customer  with  an  estimated  completion  time  for  the  application. 

Customer  Outreach 

Management  also  solicits  customer  input  by  several  means.  In  addition  to 
customer  suggestion  forms  available  to  walk-in  customers,  the  department  sends  a 
customer  survey  to  commercial  customers  and  homebuilders  on  an  annual  basis,  and 
convenes  sessions  of  a long-term  customer  focus  group  on  a periodic  basis. 

Homeowners’  Night 

To  accommodate  do-it-yourself  homeowners,  the  department  is  open  one 
weekday  evening  from  5 to  7 p.m.  primarily  for  over  the  counter  permit  approvals. 
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Profiles  of  Performance  Measurement  in  Selected  Jurisdictions  - 
California 


City  of  San  Jose,  California 

Population: 

910,900 

Department: 

Department  of  Planning,  Building  and  Code  Enforcement 

Building  Inspection  Annual  Volumes  (FY  98/99  estimates): 

4 1 ,006  permits  issued 

7,927  plans  checked 
228,101  inspections  performed 

Summary  of  Performance  Measurement  and  Business  Practices: 

Inspections 

The  City  of  San  Jose  employs  combination  inspectors  for  all  inspections,  with 
staff  specializing  in  either  residential  or  commercial  structures. 


Performance  Measure 

Target  Performance  Level 

Percentage  Inspection  Responses  within  24  Hours 

95% 

Target  met. 

95% 

Target  met. 

Percentage  Inspection  Responses  within  48  Hours 

100% 

Target  met. 

100% 

Target  met. 

Performance  Target  Development 

Performance  measures  were  developed  by  management  in  consultation  with  staff 
to  quantify  the  need  for  requested  budget  increases  to  the  San  Jose  City  Council.  These 
measures  have  been  developed  further  for  internal  use. 

Management  Utilization 

Performance  indicators  are  reviewed  on  a monthly  basis,  and  are  reported 
bimonthly  to  the  City  Council.  Management  utilizes  these  measures  to  gauge 
performance  on  both  a group  and  individual  level.  If  performance  falls  below  target 
levels,  several  options  exist,  including  refresher  training,  review  of  inspection  district 
boundaries,  and  in  the  long  term,  reviewing  necessary  staff  levels. 


sum 
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Plan  Review 

Target  turnaround  times  are  specified  by  plan  type  for  the  initial  review  only. 


Structural  - 
Residential  Plan 
Review 

Performance  Targets  by  Plan  Type 

Performance 

Measure 

1 Story 
Additions 

2 Story 
Additions 

Custom 

Homes 

Tract 

Multi- 

Family 

Misc. 

Calendar  Days 
for  Initial  Plan 
Check 

10  days 

14  days 

2 1 days 

28  days 

35  days 

1 4 days 

Structural  - 
Commercial  Plan 
Review 

Performance  Targets  by  Plan  Type 

Performance 

Measure 

Tenant 

Improvements 

Minor  Structural 

New  Construction 

Calendar  Days  for 
Initial  Plan  Check 

1 1 days 

1 8 days 

32  days 

Additional  Plan  Review  - All  Plan  Types 

Performance  Targets  bv  Review  Tvi>e 

Performance  Measure 

Plumbing 

Mechanical 

Electrical 

Calendar  Days  for  Initial  Plan  Check 

1 4 days 

14  days 

4 days 

Performance  Target  Development 

Performance  measures  were  developed  by  management  in  consultation  with  staff 
to  quantify  the  need  for  requested  budget  increases  to  the  San  Jose  City  Council.  These 
measures  have  been  developed  further  for  internal  use. 


Management  Utilization 

Performance  indicators  are  reviewed  on  a monthly  basis,  and  are  reported 
bimonthly  to  the  City  Council.  Indicators  are  used  to  track  staff  productivity  but  staff  is 
not  held  accountable  for  fulfillment  of  performance  targets  on  an  individual  basis. 

Rather,  lapses  in  performance  are  viewed  as  indicators  of  the  need  for  training  or  a 
review  of  plan  check  technique. 

San  Jose  encourages  the  development  of  “specialists”  on  an  informal  basis  among 
plan  check  staff.  Therefore,  the  ‘mix’  of  plans  being  assigned  to  any  one  plan  checker 
over  a period  of  time  is  unlikely  to  be  directly  comparable,  complicating  any  purely 
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quantitative  assessment  of  individual  productivity.  Management  solicited  staff 
acceptance  of  performance  measures  and  their  usage  prior  to  their  introduction. 

Management  Initiatives: 

Public  Reporting  of  Worst  Turnaround  Times  for  Plan  Review 

While  management  continues  to  focus  on  average  turnaround  times  for  internal 
purposes,  it  has  found  it  advantageous  to  report  the  worst  turnaround  times  in  public 
forums.  San  Jose  has  adopted  this  procedure  in  response  to  frequent  comments  by 
customers  with  plan  review  times  exceeding  the  average.  This  has  allowed  it  to  shift  the 
focus  from  a ‘failure’  to  meet  the  average  to  the  goal  of  shortening  the  longest  plan 
review  times. 
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Profiles  of  Performance  Measurement  in  Selected  Jurisdictions  - 
California 


City  of  Sunnyvale,  California 

The  City  of  Sunnyvale  uses  performance  measures  in  all  of  its  city  departments. 
Performance  measures  are  linked  to  the  budget  process  with  the  objective  of  increasing 
the  cost  effectiveness  of  providing  city  services.  In  1994,  the  city  was  recognized  for  its 
performance  budgeting  efforts  by  Vice  President  A1  Gore’s  commission  on  reinventing 
government. 

Population: 

132,900 

Department: 

Department  of  Building  Inspection 

Building  Inspection  Annual  Volumes: 

4881  permits  issued 
1191  plans  checked 

31,977  inspections  performed  (4831  stops  made) 

Summary  of  Performance  Measurement  and  Business  Practices: 

City  of  Sunnyvale  inspection  and  plan  review  staff  perform  both  duties  for 
designated  geographic  areas  within  the  city.  Staff  members  both  review  plans  for 
construction  before  permits  are  issued  and  inspect  builders’  compliance  with  those  plans 
during  the  construction  process. 


Inspections 


Performance  Measure 

Target  Performance  Level 

Percentage  of  Requested  Inspections 

90% 

Performed  as  Scheduled 

Target  met. 

Percentage  of  “First  Available”  Inspections 

90% 

Performed  by  Next  Business  Day 

Target  met. 

Percentage  of  Audited  Inspections  Found  to 

95% 

be  Accurate 

Target  met. 
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During  the  year,  approximately  10%  of  the  inspections. performed  are  audited  at 
random  by  plan  review/inspection  staff  working  in  different  districts. 

Plan  Review 

The  city  issues  an  average  of  90%  of  its  permits  over-the-counter  or  within  24 
hours.  Approximately  66%  of  permit  applications  are  for  with  re-roofmg  projects,  water 
heater  installations  and  other  minor  permits  requiring  no  plan  review.  In  addition,  all 
counter  staff  are  plan  reviewers,  allowing  a higher  proportion  of  plans  to  be  checked  over 
the  counter. 

All  ‘behind  the  counter’  plan  reviews  are  performed  in  a parallel,  rather  than 
sequential,  process.  Such  reviews  commonly  involve  completely  new  structures,  second 
story  additions  and  major  tenant  improvements. 


Performance  Measure 

Target  Performance  Level 

Average  Working  Days  for  all  ‘Behind  the 
Counter’  Plan  Reviews 

21  days* 

Percentage  of  Audited  Plan  Reviews  Found 
to  be  Accurate 

95% 

*Total  time  for  all  city  department  reviews  required  for  permit 


During  the  year,  approximately  10%  of  the  plan  reviews  performed  are  audited  at 
random  by  other  plan  review/inspection  staff  working  in  different  districts. 
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Profiles  of  Perfok  mance  Measurement  in  Selected  Jurisdictions 
- Out  of  State 


City  of  Las  Vegas,  Nevada 

Population: 

452.000 

Department: 

Bureau  of  Building  and  Safety 

Building  Inspection  Annual  Volumes: 

35.000  permits  issued 

6000  plans  reviewed 

350.000  inspections  performed 

Summary  of  Performance  Measurement  and  Business  Practices: 

Inspections 

No  specific  performance  measures  or  targets  are  maintained  for  inspection 
personnel.  All  personnel  are  combination  inspectors  - conducting  a variety  of  inspection 
types.  Actual  performance  is  as  outlined  below. 


Performance  Measure 

Actual  Performance  Levels 

Inspections  per  Inspector  per  Day 

32  currently* 
22-23  target* 

Percentage  Inspection  Responses  within  24  Hours 

95%  target 
96.4%  actual 

* Approximately  60%  of  the  inspection  workload  involve  residential  tract  housing  with  minimal  inspection 
time  requirements. 


Performance  Target  Development 

Target  performance  levels  were  developed  based  on  the  department’s  historical 
experience. 

Management  Utilization 

Workload  adjustment  is  performed  on  a daily  basis  by  division  supervisors.  An 
automated  system  assigns  voice  mail  requests  for  inspections  to  the  appropriate 
geographic  districts.  Inspectors  are  responsible  for  inspections  in  their  assigned  districts. 
Supervisors  review  computer-assigned  workloads  per  inspector  at  the  start  of  the  business 
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day,  redistributing  inspection  workload  as  necessary.  Geographic  district  boundaries  and 
inspector  assignments  are  readjusted  periodically  for  fast  growth,  new  development  areas. 

Plan  Review 

No  specific  performance  measures  or  targets  are  maintained  for  plan  review 
personnel.  All  personnel  check  a variety  of  plan  types.  Total  actual  times  for  plan 
approval  (inclusive  of  all  city  departments  for  which  approval  is  required)  are  outlined 
below  by  plan  type.  Separate  plan  review  times  for  the  Building  and  Safety  Department 
are  not  tracked. 


Plan  Review  Type 

Total  Actual  Review  Times  by  Plan  Type 

Residential  Housing 

32-33  working  days 

Commercial 
(New  buildings) 

40  working  days 

Tenant  Improvements 
(up  to  5000  sq.  ft.) 

14  working  days 

Minor  Projects 

(Swimming  pools,  patio  covers,  etc.) 

2 working  days 

No  OTC  plan  checking  is  performed.  However,  for  many  minor  projects,  city- 
approved  design  plans  are  available  requiring  no  plan  check. 

Target  Development 

Target  performance  levels  were  developed  based  on  the  department’s  historical 
experience. 

Management  Utilization 

Plan  review  times  are  not  utilized  as  a workload  management  tool.  Supervisors 
review  backlogs  per  plan  reviewer  on  a weekly  basis,  and  notify  individual  plan 
reviewers  if  their  backlog  levels  are  excessive. 

Management  Initiatives: 

Express  Plan  Review  - Intensive  Single  Meeting  Format 

Las  Vegas  provides  developers  with  the  opportunity  to  ensure  compliance  with  all 
applicable  construction  codes  in  a single  meeting  through  its  Express  Plan  Review 
program.  By  appointment,  members  of  the  developers  team  meet  jointly  with  a team  of 
plan  review  professionals  (including  planning,  land  development  and  fire  plan  reviewers 
in  addition  to  plumbing/mechanical,  electrical  and  structural  reviewers)  to  resolve  all 
compliance  issues.  The  meeting  continues  until  all  issues  are  resolved,  or  necessary 
revisions  are  found  which  cannot  be  accomplished  within  the  meeting  format. 
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Those  using  the  Express  Plan  Review  system  are  required  to  have  any  planning, 
zoning  approvals  before  making  appointments,  and  must  submit  a complete  set  of  plans 
at  least  two  weeks  in  advance. 
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Profiles  of  Performance  Measurement  in  Selected  Jurisdictions 
- Out  of  State 


City  of  Phoenix.  Arizona 

Population: 

1.2  million 

Department: 

Development  Services  Department 

Building  Inspection  Annual  Volumes  (FY  98/99  estimates): 

27,000  permits  issued 

4000  plans  checked 
27,000  inspections  performed 

Summary  of  Performance  Measurement  and  Business  Practices: 

Inspections 

The  City  of  Phoenix  maintains  separate  commercial  and  residential  inspection 
staff  with  each  staff  member  cross-trained  to  assume  combination  inspection  duties. 
Performance  measures  for  each  group  are  outlined  in  the  table  below. 


Performance  Measure 

Commercial  Inspection  Target 

Residential  Inspection  Target 

Inspections  per  Inspector  per  Day 

12 

18 

Target  met. 

Target  met. 

Percentage  of  Inspections 

90% 

90% 

Performed  On  Day  Scheduled 

Target  met  - 95.6%  average 

Target  met  - 95.6%  average 

Performance  Target  Development 

Target  levels  for  inspection  performance  measures  are  based  on  an  8-year-old 
management  review  involving  time  studies  and  work  unit  calculations.  The  review 
focused  on  such  volume  measures  as  numbers  of  inspections,  stops  and  inspection 
request  calls  over  a specific  time  period. 

Management  Utilization 

Division  managers  monitor  inspection  performance  measures  on  a weekly  basis. 
If  levels  fall  below  target,  management  reviews  workload  volumes,  the  need  for 
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additional  training  for  individual  staff,  and,  if  necessary,  can  utilize  contract  inspectors 
(primarily  retired  department  inspectors)  on  a temporary  basis. 

Plan  Review 

The  Department  tracks  the  total  time  taken  to  review  plans  by  all  relevant  city 
departments  and  has  established  target  times  for  specific  types  of  plans.  These 
performance  targets  are  outlined  below. 


Performance 

Measure 

Small  Tenant 
Improvements 

Large  Plans 

(5000  - 50,000  sq.  ft.  or 
$250,000  - $5  million) 

Extra  Large  Plans 

(>  50,000  sq.  ft.  or 
> $5  million) 

Total  - 
All  Plans 

Percentage  of 
Initial  Reviews 
Within  Target 

90% 

90% 

90% 

Time 

Target:  14 
calendar  days 

Target:  30  calendar  days 

Target:  45  calendar  days 

Target: 

90% 

Performance  Target  Development 

Target  levels  for  plan  review  performance  measures  are  based  on  an  8- 
year-old  management  review  involving  time  studies  and  work  unit  calculations. 

Management  Utilization 

Division  managers  monitor  inspection  performance  measures  on  a weekly  basis. 

If  levels  fall  below  target,  remedies  are  similar  to  those  used  for  the  inspections  functions 
and  include  review  of  workload  volumes  and  the  need  for  additional  training,  and,  if 
necessary,  the  use  of  contract  plan  reviewers  on  a temporary  basis. 

Management  Initiatives: 

Team  Approach  for  Major  Project  Plan  Review 

For  major  projects,  Phoenix  has  initiated  a team  approach  to  plan  review.  Project 
review  teams  include  representatives  from  planning,  civil  engineering,  building  safety 
and  field  inspections,  and  are  supported  by  a clerical  staff  member  and  a Technical 
Research  group.  A Project  Manager  coordinates  teamwork  and  serves  as  a single  point  of 
contact.  Managers,  drawn  from  experienced  staff,  are  expected  to  customize  the  plan 
review  approach  and  schedules  taking  advantage  of  project  characteristics  that  may  allow 
a more  flexible  review  process  while  still  adhering  to  city  policy.  A written  agreement 
including  timelines,  estimated  fees  and  submittal  requirements  is  made  with  the 
developer’s  team. 

Permit  by  Inspection 

This  program  allows  inspectors  to  issue  permits  for  simple  construction  work  out 
in  the  field  after  an  on-site  inspection.  In  exchange  for  convenience,  the  builder  must 
bear  the  risk  that  already  finished  work  will  not  meet  code  standards. 
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Permit  by  Appointment 

Primarily  targeted  towards  mid-sized  commercial  projects,  the  permits  by 
appointment  program  bring  together  the  building  developer’s  team  with  a Department 
team  including  planning  and  building  safety  professionals.  To  the  extent  possible, 
compliance  issues  are  resolved  at  a single  meeting. 
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Profiles  of  Performance  Measurement  in  Selected  Jurisdictions 
- Out  of  State 


City  of  Portland,  Oregon 

Population: 

510,000 

Department: 

Bureau  of  Buildings 

Building  Inspection  Annual  Volumes: 

49,814  permits  issued 
18,278  plans  reviewed 
176,290  inspections  performed 

Summary  of  Performance  Measurement  and  Business  Practices: 

Inspections 

The  City  of  Portland  utilizes  combination  inspectors  for  most  inspections 
performed.  Single  certification  inspectors  are  used  only  for  certain  commercial 
structures. 


Performance  Targets  by  Inspection  Type 

Single  Certification 
(Commercial  only) 

Dual  Certification 

(Commercial  only  - 
Structural,  Mechanical) 

Combination  Certification 

(Residential  only  - 
Plumbing,  Electrical, 
Structural,  Mechanical) 

Performance  Measure 

Inspections  per  Inspector 

10-12 

12-14 

14-16 

per  Day 

Target  met 

Target  met 

Target  met 

Percentage  Inspection 

95% 

95% 

95% 

Responses  within  24  Hours 

Target  met 

Target  met 

90  - 93%  range  met 

Performance  Target  Development 

City  of  Portland  performance  targets  are  based  on  department  historical 
experience  and  are  generally  accepted  as  fair  measures  of  individual  productivity  by 
inspection  staff. 
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Management  Utilization 

Management  reviews  performance  measures  on  a monthly  basis  to  determine  if 
targets  are  being  met.  Short-term  remedies  include  the  use  of  overtime  hours  and 
readjustment  of  the  number  of  inspections  assigned  per  inspector  by  geographic  district. 
Should  these  remedies  fail  to  raise  performance  to  targeted  levels  after  a 3-4  month 
period,  the  need  for  staffing  adjustments  is  examined. 

Plan  Review 

Performance  measures  for  the  plan  review  staff  include  target  review  times  by 
plan  type  for  both  initial  and  subsequent  reviews. 


Performance  Targets  by  Plan  Review  Type 

Performance  Measure 

New  Single  Family 
Residential 

General  Commercial 

Major  Projects 

Working  Days  for 
Initial  Plan  Check 

10 

15 

Required  time  estimated  on 
case-by-case  basis  after 
multiple  discussion  sessions 

Target  difficult  to  meet 
due  to  staff  turnover 

Target  difficult  to  meet  due 
to  staff  turnover 

with  developer’s  team 
Estimated  targets  met 

Working  Days  for 

5 

5 

14-16 

Subseauent  Plan  Check 

Target  met 

Target  met 

Target  met 

Percentage  Plan  Check 
within  24  Hours  (OTC) 

60%  of  total  plans 
reviewed 

Target  met 

N/A 

N/A 

Performance  Target  Development 

City  of  Portland  performance  targets  are  based  on  department  historical 
experience,  but  are  dated,  based  on  12  year-old  data.  However,  the  City  is  currently 
engaged  in  a major  effort  to  develop  more  current  performance  measures. 

Management  Utilization 

Management  reviews  performance  measures  on  a monthly  basis  to  determine  if 
targets  are  being  met.  Short-term  remedies  include  the  use  of  overtime  hours.  Should 
these  remedies  fail  to  raise  performance  levels  to  targeted  results  after  a 3-4  month 
period,  the  need  for  staffing  adjustments  is  examined. 
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Management  Initiatives: 

Shortening  Permit  Approval  Time  Across  Departments 

Management  initiatives  include  a current  review  of  the  permit  approval  time  per 
department.  This  review  would  seek  to  determine  the  average  time  needed  by  each 
department  for  its  review  of  permit  applications,  including  planning,  public  works  and 
other  city  departments  as  well  as  the  Bureau  of  Buildings.  This  initiative  will  form  the 
basis  for  a larger  organizational  change  combining  planning  department  and  building 
bureau  plan  review  staffs,  and  placing  the  Bureau  of  Buildings  in  a project  management 
role  with  regard  to  the  overall  permit  approval  process.  The  Bureau  is  negotiating 
agreements  with  each  of  the  relevant  departments  specifying  customer  service  and  other 
goals.  These  agreements  will  eventually  be  expanded  to  include  approval  time  targets  for 
each  department  involved. 
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Profiles  of  Performance  Measurement  in  Selected  Jurisdictions 
- Out  of  State  


City  of  Seattle,  Washington  (Inspections  Only) 

Population: 

540.000 

Department: 

Department  of  Design,  Construction  and  Land  Use 
Inspection  Services 

Building  Inspection  Annual  Volumes: 

25.000  permits  issued 

85.000  inspections  performed  (25,000  structural;  25,000  plumbing;  35,000  electrical) 

Summary  of  Performance  Measurement  and  Business  Practices: 

Inspections 

Seattle  utilizes  a single  performance  measure  to  gauge  inspector  responsiveness. 


Performance  Targets  by  Inspection  Type 

Performance 

Measure 

Plumbing 

Electrical 

Mechanical 

Structural 

Percentage 

95% 

95% 

95% 

95% 

Inspection 
Responses  within 
24  Hours 

Target  met. 

Target  met. 

Target  met. 

Target  met. 

Performance  Target  Development 

Performance  targets  levels  are  set  based  on  historical  experience. 

Management  Utilization 

Management  reviews  a two-week  sample  of  paper  logs  on  a quarterly  basis  to 
determine  the  percentage  of  inspections  meeting  the  24-hour  target.  Performance  levels 
below  the  95%  target  are  primarily  the  result  of  staff  turnover  and  unanticipated  leave. 
New  staff  recruitment  has  been  complicated  by  private  sector  demand  for  similarly 
skilled  personnel. 

While  no  inspections  per  inspector  per  day  targets  are  set,  supervisors  adjust  per 
inspector  workloads  on  a daily  basis  with  a limited  number  of  inspectors  acting  as 
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“roamers”  covering  multiple  areas.  (Inspection  assignments  are  made  based  on 
geographic  area.) 

Management  Initiatives: 

Technology  and  Customer  Focus  Groups 

Management  is  currently  examining  different  automated  permit  tracking, 
inspection  assignment  and  IVR  (interactive  voice  response)  systems  to  improve  work 
performance.  In  addition,  the  division  is  working  with  internal  staff  and  external 
customer  focus  groups  to  redesign  the  inspection  process  to  be  more  responsive  to 
customer  demands. 
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Supplemental  Benchmarking  Survey  - CCSF  Comparative  Performance  Against  Select  Jurisdictions 
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RESPONSE  TO  THE  AUDIT 
DEPARTMENT  OF  BUILDING  INSPECTION 


CONTROLLER’S  AUDITS  DIVISION 
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City  and  County  of  San  Francisco 
Department  of  Building  Inspection 


Willie  Lewis  Brown  Jr.,  Mayor 
Frank  Y.  Chiu,  C.B.O.,  Director 


June  7,  2001 


Mr.  Ed  Harrington 

Controller 

Controller’s  Office 

City  Hall,  Room  316 

#1  Dr.  Carlton  B.  Goodlett  Place 

San  Francisco,  CA  94102 

Dear  Mr.  Harrington: 

As  with  any  agency,  we  realize  that  improvements  to  our  service  delivery  are  part  of  a 
dynamic  and  ongoing  process.  To  that  end,  the  Department  of  Building  Inspection  was 
pleased  that  your  audit  included  not  only  a survey  of  our  customers  but  also  a survey  of 
our  staff.  The  results  of  the  survey  demonstrate  that  91  percent  of  the  customers 
received  fair  to  excellent  service,  “86  percent  felt  that  the  Department’s  staff  had  been 
helpful  and  courteous  during  the  application  process."  These  results  also  highlight  our 
efforts  to  improve  service  delivery  to  all  our  customers.  Indeed,  we  are  often  in  the 
unique  situation  where  our  “customers"  are  multiple  parties  for  the  same  application. 

We  must  often  service  not  only  the  homeowner  but  also  the  contractor,  architect,  and 
neighborhood  for  the  same  project.  We  are  also  in  the  role  of  communicating  not  only 
to  these  multiple  parties  but  assisting  in  the  communication  between  the  parties. 

In  addition  to  customer  satisfaction,  the  Department  also  worked  hard  to  achieve 
employee  satisfaction  by  offering  resources  and  training  to  employees  in  an  effort  to 
improve  their  job  performance.  Results  of  audit  survey  of  staff  demonstrate  that 
“approximately  80  percent  of  employees  feel  their  own  work  units  are  well  managed, 
and  that  their  divisions’  management  has  high  standards  and  expects  high  quality 
work.”  “Employees  indicated  what  they  like  best  about  working  for  the  department  is  the 
professionalism  and  friendliness  of  co-workers,  helping  the  public  and  ensuring  public 
safety,  and  the  jobs  they  hold  or  the  type  of  work  they  do. 

Our  response  to  the  five  chapters  of  the  audit  is  as  follows: 

The  Department  not  only  gauges  the  efficiency  of  our  efforts  but  also  measures 
the  effectiveness  of  its  work.  The  Department  has  several  mechanisms  to  gauge  the 
effectiveness  and  quality  of  our  work.  In  the  Inspection  Program,  senior  staff  routinely 
conduct  spot  check  inspections  and  ride  along  inspections.  The  Inspection  staff  also 
meets  frequently  with  Permit  Services  staff  to  discuss  quality  control  issues  affecting 
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plan  review  and  field  inspections.  Senior  members  of  the  plan  check  staff  also  conduct 
reviews  of  plans  that  have  already  been  reviewed  by  other  staff.  If  the  senior  staff 
determines  any  errors  made  by  the  plan  checker,  they  will  institute  internal  training  on 
those  issues.  In  addition  to  these  quality  control  measures,  the  current  system  of  plan 
review  and  field  inspections  incorporates  inherent  quality  control.  In  the  current  permit 
application  process,  plans  are  submitted  to  our  Central  Permit  Bureau.  Our  plan  check 
staff  in  addition  to  review  by  senior  staff  and  other  divisions  reviews  these  applications. 
After  a permit  is  issued,  field  inspections  are  then  conducted.  During  this  process,  there 
are  numerous  points  of  quality  control  measures.  Additionally,  our  Code  Enforcement 
Division  also  provides  another  opportunity  to  ensure  that  we  are  fulfilling  our  mission  of 
safeguarding  the  life  and  property  of  San  Franciscans.  However,  consistent  with  the 
audit  findings,  the  Department  has  failed  to  report  these  measures  as  performance 
measures.  In  the  past,  the  Department  has  worked  with  the  Controller’s  Office  to  devise 
appropriate  performance  measures.  The  Department  will  continue  to  work  with  your 
office  to  incorporate  and  report  on  our  current  quality  performance  measures.  The 
Department  will  also  work  on  ensuring  that  our  performance  measures  more  clearly  ties 
to  a strategic  plan  that  outlines  the  Department’s  mission  and  its  programs. 

Although  the  Department  does  refer  construction  projects  that  are  subject  to 
impact  fees,  the  Department  will  improve  its  procedures  to  ensure  that  all 
projects  are  appropriately  referred  to  Municipal  Railways  and  the  School  District. 
The  Department  has  relied  on  staff  to  identify  and  refer  such  projects.  However,  since 
the  audit  results,  the  Department  has  begun  updating  and  drafting  administrative 
bulletins  and  office  policy  and  procedure  guidelines  to  ensure  notification  and  collection 
of  Transit  Impact  and  School  District  fees.  The  Department  is  also  working  on 
establishing  automated  tools  such  as  automatic  electronic  links  to  the  Transit 
Development  Impact  zones  so  projects  will  automatically  be  identified  and  creating  a 
database  that  will  also  identify  projects  at  the  time  of  filing,  that  is  subject  to  the  SFUSD 
tax.  Concurrently,  at  the  time  of  identification,  a daily  report  will  be  compiled  and 
automatically  generate  a report  to  be  provided  to  the  School  District  and  Municipal 
Railways.  The  Controller’s  Office  also  recently  prepared  a report  on  the  handling  of 
these  fees  by  the  Planning  Department  and  the  Department  of  Building  Inspection.  Our 
Department  will  work  with  Planning  as  well  as  your  office  to  establish  further  controls  as 
it  relates  to  these  fees. 

The  Departments  has  already  made  improvements  to  monitor  employee 
certification,  training  and  evaluation.  The  Department  is  also  working  on 
improving  its  fleet  management  practice.  The  Department  has  recently  established 
policy  guidelines  for  monitoring  certification  and  training.  These  procedures  will  ensure 
that  certification  and  training  is  monitored  and  that  they  will  be  linked  to  the  individual 
employee’s  annual  performance  evaluation.  This  information  has  also  been 
incorporated  into  a new  database  maintained  by  our  Personnel  Division  for  the  purpose 
of  monitoring  compliance  with  AB  717.  The  Department  has  also  established  April  1st 
as  the  annual  performance  evaluation  date  for  the  majority  of  our  employees.  Since  the 
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finding  of  this  report,  the  Department  has  improved  its  record  on  performing  annual 
personnel  evaluations.  The  Department  has  also  issued  a memo  to  all  staff  to  ensure 
staff  compliance  with  federal  law  that  requires  reporting  on  unpaid  car  benefits.  The 
Department  is  currently  reviewing  its  vehicle  assignments  to  determine  whether  a small 
vehicle  pool  can  be  established.  Vehicles  are  currently  distributed  pursuant  to  union 
memoranda  of  understanding  that  requires  providing  inspection  staff  with  city  vehicles. 

The  Department  utilizes  the  Permit  Tracking  System  to  maintain  performance 
statistics  and  is  also  currently  implementing  several  additional  automated 
mechanisms  that  will  provide  information  on  it  productivity  and  promptness.  Last 
year,  DBI  implemented  a new  Oracle  based  permit  tracking  system  and  has  begun  to 
develop  a tracking  and  reporting  system  for  performance  of  all  divisions.  Additionally, 
DBI  is  currently  working  on  implementing  a document  tracking  system,  which  will  further 
enhance  the  productivity  and  timeliness  of  permit  review.  The  Department  is  also 
coordinating  its  efforts  with  the  Department  of  City  Planning  to  improve  the  overall 
function  of  the  Permit  Tracking  System. 

The  Department’s  customers  and  employees  generally  express  satisfaction  with 
the  Department.  The  Department  is  pleased  with  the  responses  from  the  customer 
and  employee’s  survey.  The  Department  will  continue  to  address  those  outstanding 
issues  raised  in  the  survey  results. 

Overall,  the  audit  report  was  insightful  and  will  certainly  be  useful  in  our  ongoing  efforts 
to  improve  our  sen/ice  delivery. 


Vprv  tml\/  v/nnrs 


Frank  Y.  Chiu, 
Director 
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cc:  Mayor 

Board  of  Supervisors 
Civil  Grand  Jury 
City  Attorney 
Public  Library 
Budget  Analyst 
KPMG  LLP 
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